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•§) It is*^ 6 'iym^mm l r , ^toynwi^-t^ nmuw 

rzxtimmt^^u-z>i>frmm-t:s,ct^nmt-t?>m 

i,cxt}^tircmm^^m-t^xtimm^mT.mt. 
mtcicmp>tircxtimmicm-^\^'r. mm^mcm^^ 

mrci,cxt]ti\rcxt}mmicm-:3i^r. ±miim.^mc 
±mnmmm^mit. ±iixtimmicm-^\'^r. ±8bib 
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^^i^tcfGurtTiii^-rscii^iteit-rsii^JieiBij 

iiARS6IBac«0nd->-y hSBo 

^£;cr^7ifiLfc*g^^^^■r^TIi!)«g^1i?B^:. mmx:hm 
mrci,cxtif^txrcxtimmi,cm':5\,^x. lam^^mc 

[w^js 1 0 ] mm^mmt^xtimm^m^m. t . 
±mxtjmmmni^mmm Lrcxt)mn<r>^m.m^m 

^tE^WLMicm-^i^r. ±Mixtimm^i^m-t^m^^ 

±tExt}mmco^micm':3i^x. 'nm^-t^nmum^ 

xtimm<D^m^^wr^^m^w^mt^m^^ct 
[fi^^i 1] ±mx:hmmti\ mmmmxumpm 

So 

mmm L /c^^m A^^^T-^ tcWt^^nt t $ . ±fBA 

:hmm<D^m^^m^^ct^^WLtir^imm\ oib 

30 im^m 1 3 ] xtimmmm^mii'^^tii l /-c A:'3if ?s 

±nmmm^tiij:mKx^mLrc^mmicm-:5\.^x. ± 
Mixiimm^^mt^mm^mxm t . 

±mmm^m:Lmic^i,f^±mxtimm<D'7^mi,cm-:i\.^ 
X. 'um^t^ 'umumum t ±$inmmmi:mc xm 

mmm^^\^^mc i.rc±iiixf]mm(D^m^^m-r^ 

^^•JS^MXig t ^ 5 C i: ^!|#® i: -r S n >y h ^B 

40 [mim 1 4 ] ^^nnm^^mt^^^ntm^-^ 

(Dmmticm-^ii'x. nm^T^nmum^mt^mK 
m^mi 5] ±mm^Mm^¥f^^mi. xtimm 

50 •t^nma^^mnmmhx.xt^-^^nh^^Wiii-t 
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3 

m^m.^mc %m.-t ^ 12111*1 1 . 

»t/£ =S:1^til L fcil^l i: ±t2fB1i*©lcf Bit L 

±f 2»j{l5a5W^ij<l5 ^ -li- fctocDMIiJgP i: . 
±H21!jita!«^/>LT51-;^37!)Wffl UTV^^±l2BBaia5(0 

±82«ltH#ia*^«^mL/£±l2B8Iiia5<0«^t±iBn;^ h 
[tt*^2 1] ±fB1^ffi¥lg{i, ±l2Hgi1gP®<^Sit 
±8B^S#@«. ±82^m#©*^«ltiibfi:n:'3t±fBK 

[ii*3S2 2] ±i2i^ai^m{±. ±i2Kii5a5£Dmii: 

±aB¥^*©a. ±IB^ai#l5A^1^tli L rc±gB S^M i: 

±8B^g¥Sci. ±f2i^[ij^s*^i^ai i.rcmtLrzmm 

S ISjJcJS 2 2 IB«c<0 D d-C y h ^Ho 

^ IBMiiigPO^ffi i: »-:3v ^ Tfi/T^tOlft^t ^ * -(i 5 
g2^<on4?>y hSBo 
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4 

±B2^ai#S*^1^dl L/-cMSi1g|50^^«^i:S•^!u^T±32ifi 
It gptttc {iFffl ^ § ^ t» ^l^tii-r ^4:^«im#l9 i: *1«^ 

[ii*^ 2 7 3 ±t2«ldi*mt±> ±f 2B8®ia5«l^ffi h 

±f2^1-:^^tii#©t±> ±l2^^di^SA^1^m bfc±82B<f- 
fii^;3^jSiHBi:©MtcS^i/^T±fBi^:'3^^tti-r ^ c fc* 
70 ?^gS!t:fSff*:^2 6gB«o5n:'3«ldi^go 

[ii*3S2 8] ±iai^m¥is«. ±iBMgiigi5(om^© 
^mm.h-m^\m.h<nm.^\^x. ±Mm\'^uu^i\\^tc'A- 

?^mimmcm':3^^x±EE9\-ti^ikm-r^ct^nwLfr 
mmm 2 7 mm<ont)^tiimSo 
[»*^2 9] mi^siiu^mi'f-^^^tctb<omm^(D 

^mbfc±lBgflii1g|5c04^^tcS-iiV^T±8BibffgP«tc1^ 
[000 1] 

ffi Mate ^^tb-r 5 i^;'a^aj^H&a*J1-;'3^ttl7a ffi 

[0 0 0 2] 

30 ^m^ft^iy<DXS>-:3rCo 

[0 0 0 3] TLEARNING WORDS FROM NATURAL AUDIO-VI 
SUAL INPUTJ (Deb Roy, Alex Pent I and) (J-XT, ilM 

[0 0 0 4] iii<t{B^i:^?s«^ i^mm^) t^mm 
^[,Hmm^m/ikLx^m>':^7-L.icxt)-^^^o :ict^ 
1 xHt. ccD^o icmm^i^iiv^m^mmLx xti^n 

rcmi^tU^(O^To:)'<^>h (Event) ^AV-Y'^i/ 
40 h (AV - Event) fcif A.T'V>5„ 

[0 0 0 5] cco^^icxti-^rLfcmmiM^Rrjm^m 
('Jj!jU>h-:i-^/l'^>y h) Rzs^m^vi^noo 
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5 

[0 0 0 6] fl^j;^tf. "^(oMMVi^t. mmmMHMM 

(Hidden Markov Model) ti^mm~r^o mUmrnHM 
[0 0 0 7] ^LT. [pJBt^^tcllt-^fflfll (fflP^ 
[0 0 0 8] mtf. JiiiliCOJ:^^^^tcJ:nti\ 1^12 

. • • • ^^c5i^sH^nTo^^^ij^t^^x^cJ:DA 

-ka". "a-o", "ki". • • • lltC^^^^tl 
[0 0 0 9] ^LT. •^^OcJ:'9^^^X5j'^^n/cIi]^ 

^OSm^bT. ^^>^X7^A2 0 Oti. "a-ka" 
[0 0 10] 

[liB^jO^^i^bJ;^ ^-r^ii^] tc^r\ 34^. /ilffl 
O^it (J^fi^gH) Vrtgpmi (rtWMH. (?iJx.tf. ® 

f^^hHtmm.h^'y^'y'^iyBiy WIS) ^"T^cfc^^ 

[0 0 1 1] C<Ocfc^^n4<*y hSHtc^oi/^T 

[0 0 12] b;b^L. ±M\^tc^^^m «g^l) 

[0 0 13] 5t-r\ ±aiL/cJ:^^^^^ST'ti. tTift 

[0 0 14] ±}ii^tD5:fflf 1 THj:. m^it. xt3m^\^n 
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^^^^i/aV (WIS) ^bT. A^jM^^^^O^SS 
^•r^tH^^j (^^) *^5l^a6<E>n§t>ttT'ti^<. A;^;tc 

[0 0 15] ^tz. mmmm^m^ts^mm'&m-v<om 
gt^f^^^.^tc^vx^jM-r^^^. 

^"Dr^m^. :^il^tTKj:^^^^n^<J;"9tc^vX5^^mtc 

[0 0 16] ^fc. t^5K(0*plS5it#^i/nislfiMm^ 
^ L T O ct: ^ ^S: » ffi e> *S ;S ^ n T 1/ ^ ^ o 

(1) . iii#fi#<^^-^x5i^JB^®TLi^^vX^^^-r 

(2) . ^sfi^fo^^x^i-a^ifTH/^^^x^^^'r 

20 (3) . 3Sa (1) (2) i:co*S^^*^t;ottS 

[0 0 17] t-e^^A.. cntXJ1'Ollfig;?3M^ilP^nTV^ 
^tOtfe^o b*^L> '>:^< ilfeC<0 3 0;0^1t^Slg 

[00 1 8] C<Dmm (1) SD'^g (2) o^^x^ 

gijffi. Bt^6^i5:^^X5j^li^gS^^*1t1iJ5:#i£>^'«#fi-r 

50 [0 0 1 9] iii^§^^:ov^T^i. e?iJAti\ fe^P^tc*5i^T 

Wfe. Sfe. htilfett^ 

LTKtcfe^fecoiBlt«l^^A:^fe<?:>1^St^P^'e(OiSg| 

[0 0 2 0] — ^S". ^^tCOV^Tti. glil^ffi. HMM 
cfc ^ A;^ ^ n/c^ii^?ij ^ HBti ^ tlT V > § ^H^^'J ^ 

[00 2 1] ^Tc. ±8S31@ (1) . ilg (2) coifrL 

[0 0 2 2] A^^fi^tc^tfb. K^^o^^xtcm/i-r^ 
50 ntf. ^(DXtiiE^^t(D^'77.icmm'^^. ^^xm 
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[0 0 2 3] m^i^£. gfbl/^^^XCO^fe^^UTti. li 

BO:j7^X. • • •) terns b?5:V>^¥iJ»r L/C ^-^^ 1^ 
3^ (A) tc^*rJ:^(c. V-^fe^^^X (CTx.tf. Pi 
^Aco^^X) ^^^i-iiJUTSr/ci^iS^cD^-^X^^^ 
b> ^i/^ti^i^-^Xtcoi/^Ttis ia#^0^-^X (^aO 70 
^^X. g/30^^X. • • •) tcmML5^v^i:WKb 

/c^-g-. lasff (B) {c^-r^oic^ (/^sfe^^^x 

(g/3c0^vX) Jgr^fiJLTI&Tfci^&^tO^^^^X^^^-r 

CV[n] = lC[rk] (0^n<NlC) 
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[0 0 2 4] ^/c. ±HB31@ (3) OH<§i:g^O^^X 

[0 0 2 5] iB®oiSgiji57^XJ^^^ h;i/ a:^T. MiSi 

^^ij^^ h;U^l/^3o ) IC[i] (i=0. 1. 
• . NIC- 1 ) . g<OM8iJ^^X(D^^ hJV iVAT. ^ 
^SU^^h^b^i/^do ) SC [J] (j=0. 1. • • 

Nsc-1) t-r^o mfn (i^^<Drc^\cxM 

[0 0 2 6] gB^.S^c03ffi^JB1tTti. iii#MSiJ-<^ 
h;l/I C^^^SU^^h^bSC^^. (1) iCJ^t/ 
(2) ^T^^t*c tff^-r:^^ 1 h;i/i:-r^o 
[0 0 2 7] 

- - • (1) 



[00 2 8] tg!(2] 

CV[n]=SC[n-NIC] (O^iKNSC) * ' ' (2) 

[0 0 2 9] ^4b\ ea^.S^t0513BfB1ii:LTti. 20 5KSfflSSloaSfH«Ci. (3) ^cOdelta_W^:l/^^vh 
[0 0 3 0] #^^h;Hi. ^^C0cfc-5tci OO^^ h;l/ [0 0 3 1] 

tc:^^n^o h;i/c v^^ij-<^ b;i/h-r^hi^ [^3] 

delta_W=CVxtrans(CV) " • ^ (3) 



[0 0 3 2] cntCckt). B^SiJSt (A:^i$nfciii^) 

^fe^^^X^^j&L. ^tO^-^Xtc#|^|giS^£^cD^ 
ig (c:ntit^iJ:^tfHMM£7:):i7"5'X) h?SCFotti»C^30^ 

-^mtrs^o wmsM) ^srti^b. 

# ^ ^ X f)mm^m±(Dmmm^^^i^tmm^c o xig^ 

IWll^tc^^ "a-ka" t\^^o^m^ 
?iJtc«^^X3b^3S^^;^€^t:^j5l£*r^jO^ ^n?>^± 

tcJ;oT. [p]C$iMtctiloIUiii<^i:^^co^^X3b'^iSi^ 

H M MCO ^ ^ X:6^jlMfati^ nSo 
[0 0 3 3] — rperceptual ly grounded meaning 
creatlonj (Luc Steels, ICMAS, Kyoto 1996) iVA 

T> ^UZth^Oo ) Tti:. T-VX^U^^^->^3>y 
-ix (Discrimination Game) ^ii?^H®^T-^.f5t®f#^ 

[0 0 3 4] i/x-rAti. ±ai^OJ;'9tciii^^^^i:t* 

m ^ -ric -IIS -tr>-9-^^>^>7i/i: ^mm^ihm t ^ 

ggtCcfcO. oi— >?x>h (agent) 



(object) tc**Ls fficO:^:/v^x^h (Ktci^.JObTl/^ 
[0 0 3 5] ^LT. zyy^'rL.^mts -trU^i^a^X 

40 <D^or^mm^^K>. ES"j^cfct)S<-rsx->^x>h 
[0 0 3 6] ix±7b'«T-vx^u ^^t'^-v'a >y-Acoia 

[0 0 3 7] ^/c. TThe Spontaneous Self-organizat 
ion of an Adaptive Languagej (Luc Steels, Mugglet 
on, S. (edj (1996) Machine, Intelligence 15.) 

^^2t\.^Oo ) T'Ci. (La 
50 nguage Game) i:i/^^#ffiT*m8g<0^3t^^i:Tt/^So 



-5- 



9 

^ yV— A \rJK(D 3 OCO X 7^ e> ^ § o 

[0 0 3 8] lg 1 XT-^yy. yay^y— >3:x (propag 
ation) o 112 XT' y:/. ^Ux— v^aV (creatio 
n) o CfOXx'yT'Tti. X— v^'xVh (agent) 

SlSX-r^y'/. -tr;l/:7:t— ;j?J:^-r-if— v'H > (self-org 
anization) o ccox-r yyTti> rSfcfci:3M«^t£: J; 0 >^ 

[0 0 3 9] 

S.^-ii:^^3X-r^y7':^)^e^^o ±a?L/cxVX^U^ 
:t'^->' 3 vy-i:.^*. ^ 2 X-r ^y T'tcfflS^^gp^i'tiJS: 

[0 0 4 0] ^fc. mn'mmt-h(ryWi^M^\^%^}i^ 

^zL-^V^:r.y7.m^m) aXT. :ig;;4 iii/^-^o ) 

[0 0 4 1 ] :S:S^4T(i. ^4tc^-rcfc^tc. 
U^y^b (3K-r>^2 1 2T}g^b) . IrI^C^^T 

3£lib/c^»c3co^>y->>y-Atc^ott^m 1 x-r-y":/ 

3 XT- 'y :/^eS^0qfri:tTo Tl^^o 
[0 0 4 2] iffbl/^^^XtO^^ti:. 
^Vy^^—i^ay (verification) tc<i:OtToTV^ 

>T»fbV>^-^X^-3< ^^*iJKb/ci<>:^. 

•^OH M tc^i-sj-r ^ c -e^ bC> ^ ^ X^^^ 

bTV^^o 

[0 0 4 3] ^e>tc. 0 4*tJO^9l:^rPli:bT^f cJ:-9 

tc. v»>x■??^^/c/^^->2 1 1 ^ifiTb^-rchtCcfc 

0. "^10;tyv^x^h (Objl) 2 1 \^m2(0:t 
yiyx.^h (Obj2) 2 1 3<D±^UW}" tl^^omi'ft 

-^Ocfc-^J&^rX^— 2 1 OrtTb/c/^^-^tOifi^ 

[0 0 4 4] W±Ocfc'9tc. ^aJSif^iHiHlgMfttc 
rji^mic^^^r^. p4-^y h^gtc*3tt^tTift?Sf# (Tt 
(1) . A;^M#tO!^®?5P^l^^Offigii:iJ7^xmJR^<B 
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JO 

(2) . nm^f&t^<ommic^^^r(orsmo 

(3) . ^^J^^^^^'O'^^^i/a >^tT^i^«T^^^ 

[0 0 4 5] ±^<Dr^m (1) ti. m^tf^xti-^nrm 
mnmcni^r^ xmsi?«/)'^m^fi^tc;^)>/3>t)^it 

IS/ctt. gb<(i|p|B#tcA;^J^n/c^fi^. 3^(i^cD2 

[0 0 4 6] m^i£s wtW(o^'y:;^co^m^mx^}Fmc 
3fii^^^n^iii®fg^:6^Ati^n/c^<s^'r^o 

mSfp (A) tC^f^^tC. ^^XA^^^XB^ 

jb^iii#1f®^F^tc*3i/>T}fiSbTi.^^^'&Tfe§o b^^ 

b. ccrxt^-^nrcmmm^ii.. ^^i:fTbv^^^x^o 

[0 0 4 7]-75f> Ci7)cfc^:&^<^cOTT% COHf^fl 
20 ^tCj^UTv-r^^^^^cOfiilOlt^^bT. IBJB^tc^^M^ 

(mtco^vxAtc?*iSi^tt^n^^^-^x) ^^'^x 
p (H^co^^xBtcmw^n^^^^x) ^A^^ 

[0 0 4 8] J;or. H^tO^^xmSfFffitc. gtco 
•t^^c: ^*^T^nti\ iiifttcov^TtifTbi^^^x^^ 
xmSlfffl^JSB^^-^^CirtCcfcO. ^Sf^" (A) tc^ 

ft!2>?<^^^XRfTJSi^ffi^#M*r^c2:tcJ:»?. 
XcomSfPffi:6^3ii^tc^^nScJ:^tc:^§^i/>'5 ^>OT' 

[0 0 4 9] b:6^b. t> bH^fi^&r/^mi^or^T^ 

R t;^^ oi/ ^ T fr b t ^ ^ ^ X ^ -t^: C ^ ti: 

iibi/^ cnti:. m^i^£. m6^ (a) stf (b) tc^ 
■rJ:atc. ^ii^tRt/^co^^^^F^^c^3t^T^^x*^ifi^« 

bTl^^tf'^tc^'V>T. ^3^0^$i^^P^;^)>6^T^<S 

[0 0 5 0] ^cT% ^ftH^ti. ±33^commi^cm^r^j: 

50 tc*iJgiJ-rSC^3!)^T'#Sa4-C-y h^SRt/a4-:^y h^S 
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[0 0 5 1] ^/c. ±.^(Dmm (2) tcoi/>T(i> 

[0 0 5 2] miSfl^tO^fiiiiAV 

[0 0 5 3] ^Jx.ti\ 4:*:cO#P^'«3 h 
mm<r>^mWin OttSc?iJ^fl^ L T t (5 /u H <7D«|^. 

[0 0 5 4] Src. *f8Mti. cOct a^lllttii^^T 
[0 0 5 5] Sfc> ±aiOPa1S (3) tCOl/^Tti. l/^t? 

[0 0 5 6] t/c. ±aiLfc3:2:S^4 0¥r£tC:}ol^Tti. 
^-^—2 1 0±O/^^ — :x2 1 1 ^v»^XT?^ U *y ^ 

)b'«3a^^^cS^fcS^^^t^^cWbT. g^w-cotfititcfieoT^ 
[0 0 5 7] ^/-c. *ft0^ti. ii<oXor^nm\c^^r 
[0 0 5 8] S/c. Vt^(Ou^.-^ h^m 1 ti. ISgPtC^ 
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IS) ^bTV^fcA^ cnTni:-fe>*9-<oa^^OBESfflg 
J: t) ^ Vi5? 5 ^ a y;b^SJRB^nT b^ ^ C htc^ 

[0 0 5 9] ^CT\ ^fgB^ti. CCOcfc^^^lttC^^ 

^s^^^'^^v'a^^cog j^m^'0i <~r^ct ^"^mi^c-r 
j&aw^bTi/>^o 

10 [0 0 6 0] 

g^. g^tttcj£br(±iilb/ciTifi^> A:^1ffB^th^S 
>b'^«^ai bfc A^^JlS^B ^SSt/ott TtBlt-r ^IBii^S 

t. mrc{cmibnrcxt}mm\^cm'^\^^x. mm^mc^ 
^ ti$B:()^ e» 'im^mm b r . ^ (Dnm^-r ^ nmmm 

20 [0 06 1] c<D^or^mf&^m^rcuif^-j vmm^t. 

^st/-::>ttTHEit^fstcfiHitb. 'i^mum^mc^ 0. 
mc{cm^nrcxt)mmicm-^\^^x. tBit^stc^^tt^ 

[0 0 6 2] cntCckO. D>1<^y hSgti. A:^J1«$S^ 

^(omi^ihmi^tinmt^i^rjr^ifxmmi^x. nrjm 

30 ifmm^'^^o 

[0 0 6 3] ^/c. ^mmcijti^u^f^y h^mconmm 

mxmt. mmcjti^xmmi^tcnmt. xtimn^ib 
xmi^cx^ttiLfcxtimmt^^zf^^fxmm^micn^ 
m^mimumt. mrc^mibnrcxtimm^cm^i^ 
X. tm^mc:ioi-f^mmt-^'nm^mmi.x. ^(d^ 

40 [006 4] c(D^orj;,uif.-j h'mm(ovimmu'iimc 

ifi^^ssD'ottTiaiSbT. msm-(oxiimmi:i^xti 

[0 0 6 5] ^fc. ^mn\c^^^uif.-j v^&m^t. ±a? 
(Dmm,^m\k't^rc^\c. mm^^ti^-^^xtimw^&i 

^S^^ A;^tf#B>l^ttl^S:6'«<^mbrcA;^1t$fitciSbT 
tTiftb/cil^^^jj^-rtTifiSgmiSWi:. ^^A^ItfBi:^ 

*sa'ottTfBitr^fats#s^> mrc\cxti'^nfcxii 
50 b. 'Mmvim^^mm\cm-:5\,^xvim^'t^'ummm^ 
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[0 0 6 6] c(D^orjimis.^m^rcu^.y hmmit. 

[0 0 6 7] cnic^O. a4<-y h^Bfi, A^bitlSt 

mat. n\5i-^t\?>'im^^s^mmcm-:stm^co'im^ 

[0 0 6 8] Sfc. *5eH^lct^SD.1-'-v h^ScotTl/jfliiJ 

^mt>mih L fcA:^if ffitc/s uTtf if) Lfc)^s^^N-r?T 

[0 0 6 9] C£0J;^^a4-c>y h^gcoffiftW^^^St;: 
[0 0 7 0] $fc. *fg0;^tc{f5a4?-y h^gti, ItfH 
fa^cS■i!^^T. :yi^tfift^?l€^2cLfcA:^1i?SO^JS 

[0 0 7 1] cntJ;*?. ad-Cy h^B»±, A:^iiffi<0 
[0 0 7 2] S^c, 2t:fgB^^C^I^5D.1-^y h ^gtOtTii!)®! 

^m'^^my.tzxfimnco^m.m^^m-t^i^mm'^m 
T. A:'3ts^^5i-3^-r5is^ij^iixgi:. mm^f^mTM so 



!Rpgfl2 002-160185 

[0 0 7 3] c:(Dj;-5^cad<-y h SgCtTiftMSiTs ffitc 
J: (3. ad-:«yh^§«. A:^1f$S<O^^ISfcJSCTtfi(J«: 

[0 0 7 4] ^fc, 2|s:5IMtc#Sa4-'-y h^Sa. ±a> 

^l^cOlf^g^lBli-r^iBlt^ISi:, Sr/t^l^mL/i^^i: 

[007 5] C<D<i:3^mfiK^fiiA/i:a.t>-y 

[0 0 7 6] cntcjcfjs n.fE-yhSB«, ^^ti^^ 

mmi^x. ^ifm-<oMmm'^x:h-^txrzmici,i. m 

[0 0 7 7] ^fz. *%H^^c^^a^^y h^S<0?fift»J 

xm-^\.fz^^nmn<r>mn^mm.^mct^m-t^m'& 
jLm.iL. mzrs.if^^x.rzmamm.^m.Ktmi^tz^'SM 

[0078] C<D<k^%njJ<yh SS<Otf 1**11895? fttc 
.fcO, a4->-yh^Ht*. ^^*t*1^^BBtiLT, St>'|S) 

[0 0 7 9] $fc. 3^56BflfcfiSSa.-f;>y h^gti, ±3? 

^^^tz^nm^^t. m\fu^^i\\^x^tsmfm\^ 
x\.^^mwiim<Dism^^}^t^^^m^h. ^m¥i§*'« 
tk^ \.rzm^^<r>m^h9\--hh^n^^-&^x^m-t^^ 

[0 0 8 0] C<D<td'5:«lfi5t^«A/iad?y h^B(±, 

mi^^^^iri^x^m'^i^m Lx\,^^mmm<oyim^^ 
mitt^mmm<ovimictiiii-s-&x mmnti^^mt 

So 

[0 08 1] s/c. :^^mic^.^9^ti^tiimmi,i. ±xE 
rzmsi^(Dikmicm-:5\,^xmi'fSiimicimt^nti^m 
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[0 0 8 2] c<o^orsmfiS,^m^rcnt}^ihmm(^t. 
[0 0 8 3] ^fc. ^mmcm^nii^ihyjmit. ±a? 

[0 0 8 4] 

m<omm mmmm:> ^^gptomi (rtw^a) tcisi; 
[0 0 8 5] mmmmxi^t. ^t-r. ti^:^ hmm(Dm 
mM(Dmm^i^\fC'o\.^xmmicmmr^o 

[0 0 8 6] 

( 1 ) ^mmmmic^^u^^y hmmcomf^ 

^'npg|5n.-^y h3 A. 3B. 3C. 3 D;6'«^$g^n^ 

f&-^nxi^^o 

[0 0 8 7] BMi^gP^^^y h 2tcti:. mS{C7jk'r<^o 
tc. CPU (Central Processing Unit) 10. DRA 
M (Dynamic Random Access Memory) 1 K y^^yiyrt 
ROM (Read Only Memory) 1 2> PC (Personal Co 
mputer) hV >^-:7 x-xmSS 1 SRt/e^SaH 

mssi 4:6^rtgp/^xi s^ftLxmrncmM-^ti^ct 

tCcfcOff^^^n/cn^hn— ;l/g|5 1 6 C(Du:f:y h 
1 Oift;^i^.i:LTO/VyxU 1 7 tif^^m^nxi^^ 

[0 0 8 8] ^fc. Sa5:a-^y h 4JCti. i^gPtOt^M^ 
mm-t^fci^cOCCD (Charge Coupled Device) 

^2 0^. ^mmi)^ib(D mx^j ^ rpn<j ti^^tc 
*v^-b>+^2 1 1. myjiciiim't^^i^^xcD^m^m 
^ov^^u.t^>2 3 ^> m^^m(D^^^mtit^rc^ 

<07.\f-tf2 4 nvK^y 1 to rgj tcffl^-r^ 

LED (Light Emitting Diode) (^^-^t-T) tf^df)^ 

[0 0 8 9] tE^lC. S'BSIg|5:x-*y h 3 A-3 DtOMiS 
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gP^^^KJgB3.^'y h 3 A~ 3 DRD'flii*a5:x^'y b 2 
(O^aiSgP^^. iigp:i-'y h 4 RD'Kfl^gPa^^y h 2 <0 

^l^as^. Mt/tcJ^MgPn.- >y h 5C0]^J15 Acoa^SgP 

-2 5n&t>M-NT'>'S/3pi-^2 61-2 6n^^gEiS^ 

nri^^^o i?"JA(f. ^ 2 5 1 ~2 5 nti+i- 

IfttCcfcD. 83135:3. - >y h 3 A~ 3 DTb-^SiJ®^ nr. @^ 

70 [0 0 9 0] ^LT. cn^nmm^>^ \ s. hnmm. 

•tr>-9- 1 9. ^^y^-tr>+^2 1 . m^-ty^Z 2. 
^^4-^>2 3. Xtf— :^2 4j^t/^4^-r>^v'3^— ^2 
6 I - 2 6n ^^o^ffl-try-y-Mmc L E DSt/^T^ 

^:xx-^2 5i ~2 5nti. -^-n^^n^tis-r^^Ny 

2 7 1-2 7 n^/M.T:3>hn-;l/gl51 60fM^SaJi 
IsJgSl 4 i:g^S^^n. CCD;^^^20RDV^'yT-U 1 

[009 1] f^ai-r^cfcdtc. Iftf^ (tTWl) co^ 

9. >-f°7^y^:/3^-^2 6 1 - 2 6 n ^CDfi^jb^l^ffl 
[0 0 9 2] M^iEliillHlK 1 4ti. ±ai(D§-trvitA^e> 

m^xmoji^^. cne^^n^'nrtsisy^x 1 s^/tlt 
DRAMi 1 rtom^ffistcjiH^^^s^-r^o s/c:fi^5a 
fiiHi^i 4ti. cn^rttcy^^y-T^u 1 7A^e)«^^n^ 

A ^y 7" U Sa^g-r ^ ^ ^y T- U 51fi-r- ^ ^|IM:^^IK )Zv 
cn^DRAMl 1 rt^om^&BtcteSrtf 
[0 0 9 3] CtO^-^tCbTDR AM 1 WC^m-^tlfc 

C(D?feC P U 1 07^)^CcDu.t>^y hSB 1 

[0 0 9 4] ll^±C P U 1 Oti. n4^^yhgBlC0® 

Mf^mx-^ntcwmm. s^f^asrL-^y h2ogi^L?5:i^ 

PC:^7- KXu^y htc^«^n/cp« ;?7- K 2 8Xti 
^^^yv'iLROM 1 2tc1g*fl^nfc$iJfflya^-^A;grP 
C;^-F-r>^--7x-XlHl^ 1 S^^bTXtilfig^M 
^mb. cn^DRAMl UC+SSftf^c 
40 [0 0 9 5] ^/c. CPUlOti. C<Of^±a?C0<fc-5tC 
fi^SaSlHlgS 1 4 J: D D R A M 1 1 icM^-X^m^n^^ 

my^-^Km^\^^xi^E.Rumm(D^Si'p. ^mmi)^ib 

[0 0 9 6] ^e>tc. CPUlOti. C(OW»r*aS&t/ 
DRAMI UCtS^b/c:fflS?ya^*-^AtcS-^l/>T)li< 

r^^n-x— ^ 2 5 1 - 2 5 n ^|gKj^-ti:;i,c <hlc J: 

50 -*y hSCOmmS A^mfi^-^fcO. ^gaigp:!— ^y h 3 A 



-9- 
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~ 3 D ^lEifi ^ T >^fT ^ -ti: ^ ^ OtTilJ ^tf ^ o 
[0 0 9 7] ^fc. CCO^.C PU 1 Oti. ig^^tCjSCT 

[009 8] CCD^-5tcLTCcOn.-n'^y h^g nc*5t/> 
[0 0 9 9] (2) ^iJffliyay^AC0V:7 h^xT^^ 

(oy:7 h'j^xTltfigti. 09tc^-rJ;'9ti::&;5o coD^ 

9tC*5V>T. xV^-f X • F-^-T/^* • l^-l''^ 3 Oti. CO 
F^-r/^*^^^^T=^>'^-i'X • K'^^>'^ • -tr^y F 3 1 
CCD;^;^^20 (g|8) ^^-fv#(7)jlffl:0:3>trrL 

[0 10 0] S/c. a>t^T•^ ^ • -y--/^ • ;5j-:/v^x^ 
h3 2ti. f-VWX- F^-r>'^ • -Til's 0<DgT{a@ 
tcfigb. ^J^tf±a?iO^@-tr>-9-^r^5^:xx-^2 
5 1 ~2 5n^o/N— F»^xrtcr^-fex-r^/ci6o-r 
> ^ - y X - x^n^-r ^ y y F X TP"??^ § >^ 

• uif.-j F 3 3 i:. mM<om^^^JiE^mm'^^V 

ot-v^-tx- F^-r/^^gii-r^v:7 F'^xri¥T?^^ 

•r'M^X • F-^-T/^ • y-^' 3 5^. a4-^y F^S 

1 to<i«^gii-r^y:7 h^xrgfT3S:^v=^if>r>'F • 
Dvi^^y h 3 6 ht^hmj&'^nx\^^^o 

[0101] ^^^—iy^r • :tyv^x ^ F 3 7 (i. :t 
h • v^-V 3 8Rt/+^— tlX • 3 9 

jb^eigiS^nTl/^^o :tyv^x ^ h • 3 8 

ti. n.Kx^ ^y ^ • -9-— • :ty>>x^ F 3 2. ^ F;l/ 

• »>xr • 0. &tfT:/U^— > • 

4 uc^^n^^y^ F»^7x^¥oeift'^*?7^§Sf 
;g>y F'^xTg¥T^feO. ^t-tfX • 3 9 
ti. ;^^:';;^-F2 8 (08) tc1g$ft^nrc3^.^ a 
>:7r-r;i/tclB3il^^nTv^^#:tyv^x^ hf^iojg^lt 
$B^cs-:5l^T^:tyv^x^ Foigj^^sa-r^yy F*^ 
xTPr^fe^So 

[0 10 2] ^ F;l/ • r^/xT • b-f -^4 0(i. 
^y^ • +»--/^ • :ty"v^x^ h 3 2fD±{4^tc{itBL. iS 
<^ai^^^F5aS^H<0C<Da>1-v'y F^H 1 coS*6^^ 

«Sfig^ffl«-rsy:7F'i7xrs¥*^6iiiK^nri/^§o ^ 

/c. ryU^ — v'H > • U-f'-V4 1 ti:. ^ F;b • '^xT 

• b^-V4 OcD±{S^tC{agL. ^sS^ F;l/- »>xT • 

4 0 ^«ifi£-r §«y 7 F X rSf tc J: o T5QS^ 
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n/c5^la^5m^^:s-:5l/^Tu>K^y F^§ 1 (onm^tk'^'t 

:g>fc*6(Oy:7 F'i?xrgf;b^e)1ll^^nTl.^^o 
[0 1 0 3] ^43. ^ F;l/ • '^xT • lx^-V4 oRt/r 

>^u^-s/3>- ^^-^4 1 coM^*:^yy F-i^xrfii^ 
;^^n^'nia i otc^fo 

[0 10 4] ^ F;l/ • »>xT • l^--r-\'4 0(i. 0 1 OtC 

^•r<^^tc. ig^i^toffl. ras^^mffl. m^^^^m. 
^^mmm. ^m^^m. ^^i^Wffl. ^-y^-tr^^-y- 

70 0 — 5 8Mt/tcA:^j-tv>7^^ ^:;^^y?'^—^'^^J=L — 
;l/5 9?&H^^-r^^.iS^6 0 i:. to^^ir-^^T^^^X 

\:)^x\m^xs^^^m(o^m^^m'eiyzL-}i'Q i-e 

[0 10 5] igiSme 0CD^fi^S[lS^v^:i-;l/5 0- 
5 8ti. D.1->x^ ^y ^ • >'^^ • ^yv'x^^ F 3 2£0/^ 
a4^'^y F 3 3tcj;D DRAM 1 1 (^8);0^ 
e» ^ ^-t t'" ^ ^ RQ'g^-r 

^^xn>/^— ^^>>^^— ;l/5 9tc-^;^^o ccT\ l^ij 
^t±\ • D.t^y F 3 3ti:. m^^0ilM*I*5tc 

[0 10 6] A;'3-few-r^^x:3>'>^^-^^v^rL— ;l/ 
5 9^i. cn6^fi^ias^v^^-;i/5 o~5 8^^^^ 

> • U-r'-^4 1 (0 8) tcffi:;f7t*^o 
[0 10 7] ryu^-i^a^ • El 1 1 

tc^-r«fc^tc. tfi!j^-r>'l/^-<y^5U7 0. tfifi^SI^ 
^>^^-;b7 1 > ^ig^>?zL-;l/7 2. mm'^'f}\y7 3 

40 [0 1 0 8] tfiS^rf-Vlz-^-ry^U 7 Otcti. 0 12tC 

X. ^tx^enntLX^tc^'im^'fivi o i ~7 o n jb^^tt 

[0 10 9] ^LT. c:nP>^^flfi^7='7l/7 0 I -7 On 
5 9A^6^iJ«SIIA^^^e>n/ci:t^. af^cOl2^SSm 

50 tf^^-7i^nxt^h-'^nmtmm\^rch^r^E\z^ 
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^ nx V > wi£-r ^ »I*<0/ ^ p< - ffi^ #fiS b 6 

[0 1 10] ^^5. c:<73^SSojg^co^-&. ^nWi'ej' 
;l/7 0 1 -7 Onti. :;i^(OtTi!)^}*^-r^¥ffi^LT. 
|g 1 3 ICTfkt^ o 1 ocoy- K (m^) N O D E 0 — 
NOD E n7!)^6fifiiO^'cOy— KNODEo— NOD E n 
Xcmi^-t^ti^^^y— KNODEo— NODEn tcF^^ 

^mt^T-^ k^C 1 ~AR Cn te:?*LT^n-^'ns 

[0111] &tTiJ!l^-rVl/7 0 i -7 0 

n fri. ^n^nsacotTKi^-r;i/7 O i - 7 O n 
-r^y— KNODEo— NOD En ic^n^^n^ji^^'^ 

T> cn^)/— KNODEo— NODEn C^^tCgll 4 
[0 112] CtO«^S5^^8 OTHi. ^<0/-KNO 

DEo— NODEn tcifov^ra^^ft^-r^ A:^-r"^> 

[0 113] b/c:;5?'«oT. HI 1 4 Ot^filM^^ 8 0 T*^ 
^n^y-KNODE 1 ooT^ti. r.-f;— (B 

ALL) J t\^^oWM^^^ii^^?ihnrcm^\^. ^^mm 

m^^hm^^^hn^'t(D:^^-)\y(0 r:^^^ (S i z 
E) J rO:6^61000j OiffiaT'fe^ C rpf^Jt^ 
^l^tB (OBSTACLE) J i:i/^^ISillS^}6'^^;^e 

^X<0 rgBSi (DISTANCE)j3f?'S ro:ib^e»iooj o 

[0 1 14] ^fc. ccoy— FNOD E i o o T^ti. IS 

f^;i/7 4tc^n^'nis}t^n/c^itib&t/^a^3<<o/^-^ 

(JOY) J . (SURPRISE) J Sb<(i: 

r^cgb^ (SADNESS) J (Dh^^nt^(D?^^yf^ — ^ 

[0 115] ^/c. mi^^asoTti. rft!i(oy-F 
^(om^mms coi^tc^ott^ r^^^y-Kj co^ijic^ 

KNODEo— NODEn A^ea^T'^^y — 
T t0^ff??)^tl9 ^ I? tC a^T' ^ flfiOS y - K N O D 
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E 0 - N O D E n ^oa^fiS^jb'? rfficoy- F^Offi^ 
y— FNOD Eo-NOD E n tC^^-r^^t^:tU;^J^^ 

(Dig^fiS^J (0<ffltc*5tt^^tfO5$^c0fn(i: 1 0 0 

[%] h^oTV^^o 

[0 116] L/c*^oT. ^1 4OmiS^^8 0T^ 

^n^y-FNODEi ooTHi. m^^^ r4-;-;l/;&1^ 

70 ffi (B A L L) J ^0>i<-;l/0 rs I Z E (A^ 

^?Lhnrc^^^\c{t. rso [%] J (OfiS^-e ry-FN 

ODEi 2 0 (node 120) J frc^i^T^. ^(Oh^ Ta 
C T I ON 1 J (O'umti'^^li'^ri^^hhr^^o 
[0117] g-Rifi^T-vi' 7 0 1 ~ 7 0 n ti. ^n^'n 

C d ^m^^S^S 8 0 ^ LTlBiE^ nfc y - F N o 

DEo- NOD E n :?b'^lKot^^'^^cfc«5tcLT«/S 

20 — FNODEo— NODEn tom^M^S^^'Jffl LTSS 

[0 1 1 8] ^ 1 1 \C7r<1r'iym^^^^iy =L'-')\yi i 
ti. tTifi^T-Vb^^y-^U 7 0co^tT®]^:-rVl/7 0 i — 

7 On;b^e>^n^^ntti:/^^n^tT®]i0 9^> ^i^'&^h 

nfc®ftliiaf4<?)li5v>tT*J^-r7l'7 0 1 - 7 0 n 

F i)^xr. cn^fTlftnwF^v^^o ) ^^F;!/-*^ 

ti. m 1 2tc^V^TT(PJjtcSfE^nfctTlft^'r7l/7 0 i 

~7 On^5^'®5tiIHi;b^]g<ss^nTv^;i)o 
[0 1 19] *fc. nmm^^'ezya.-jvi 1 1*. tfift 

TL/cc^^^S^v^:i.-;i/7 2. mm^e^fji^i 3Rrs 

*ftl^'r^;l/7 4^cffi^p-ri>o 

[0 12 0] -7u> ^^^>^^-;i/7 2(i. A;^;"^^^ 

[0 12 1] ^LT. ^g^v^:x— ;l/7 2ti:. CICD^,^ 

^-ry^U 7 0tC*5tt^^*/S"r^tfii!j^7'7b7 0 1—7 
50 [0 12 2] mil. mm^e'r)]/! Sti. rgt>' (jo 
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y) J . ^^^L^ (sadness) J > (anger) J . 

(surprise) J . mm (disgust) J rS; 
n (fear) J (0^t1-6 0<^1ti[itcov>T> ^1Siftc*tfrc 

CO 1 2 3] ^{^m^\>t. ^.it^T^^vv sci. xti^-^ 

E[t+l]=E[t]+ke X AE[t] 

[0 12 5] r^ts. ^WM^^^'Plhli'^^y'r^ "7 7.^ 

^fiio^fjaAE [t] KE(om.m(o^m^^-^^tHt 
[t] \z±^r^w^m^^?i. mx^^ntcs ti^-Dtcm 20 

[t] tcA^^i^^^^^^cfc^tC^&oTl^^&o 
[0 12 6] ccT\ m:^3-trv>T--< ^xa>^7S'— 

x^mm^mt^'^^o cnti^ rR^;^^j h 

•tv^;i--;l/6 8*^iB^03i^^^i^ ±a?L/c:^S^v^^-.'l/ 30 

mmcmr3\.^x^i'im'^'f)vi o i — 7 o n owjs-t^m 

[0 12 7] tTift«gSiO;7><-hWy>7ti. tT»I 

7 IcoHii;^} (.®1t;6M^j!jP^ n/cfi 

[0 12 8] 2^tl^T';l/7 4(i:. (exer^ 

l[lcH-l]=I[k:]+lci XiM[lc] 



[t] . m.^(o't(o'mm(D^<'7^-9m^'E [t] . ^ 
<Dmm(omM^m.'t^^^\^^ ^lt. (4) 

T^^<0ii^tC^tt^^Oltift<0>'^-^P<-^filE [t + 
1] :^StBL. cn^?g?S^O^(Dltlfif7)/^^^-^fBE 

[t] hm^m^^^^\^c\^x't<Dmm<D^^'y:^'-'^m 

T^T cotSi!i<0/ ^ 5 ;^ - ^ ffl^MSr-r ^ o 
[0 12 4] 
[gi(4] 

. • . (4) 

J^^cise) J . rg1t®: (affection) j . ^miK (appetit 
e) J mS r^fiF^^L^ (curiosity) J coSi/^tc34jx L/c 4 

^Xn>/^— ^^ri^^--7b5 9*^^^;^^n§ 

ejii^r^Rmfifi^i^^^:^^':x-;i/7 i*> 
(b(Dmm-^^E\^mr5\.^xmmm\cmMit^o 

[0 12 9] m.{^m\z{t. *tE^-r;b7 4(i:. rjlift 

-;l/6 8^^6coaiai^HtcS-::5i,>Tm^t^ii»^tCci: t) 
^W^nS^^Oh#cO-?-0©(At<<7D^»lfi^A I [k] . 

m^o:>^(DWiM<D^^'y:^-^m^\ [k] . ^(Da>:*<7D 
mm.^U'tifmv. » ^lt. m^Mi^-e (5) se^^i/^ 

X:!K(Ommc^^f^'t<Dm.^(0^^'yy^ — ^m.l [k + 

1] ^^mb. ccoJSSSSm^JMffico^oa^^to/^^^ 

-^ffll [k] hH^m^cfc-^tCbT-e^OS^^tO/^-^ 

[0 13 0] 
[3&5] 

• . . (5) 



[0 13 1] r^^. |gl?)SSSt;m:^-trv>7^^^xn 40 

^-^ffio^IftfflAi [k] tc^ogjS^o^^^^x.^ 

^-^fiiO^Wj«AI [k] tc:^^^^S^&#^§<fc'9 
[0 13 2] :^*5. *^SS<DJKmc*5V^T(i. #1tll!j& 



[0133]— ^ • '^xT • ocotU;^; 
-fev>'v"^ ^x^vy'^— ^^>^i— ;l/6 8(i. mote 

•V4 1 ^^^7 iTb^e^^^n^ rts 

1^6 9(D«f£;'r^fi^isaS^i^:i->'l'6 l-6 7tC#^ 
[0 13 4] ^LTCn6(i^5flS-t>^i-;U6 1-6 
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^25i~25n (13 8) 

Xtf-:^2 4 (1^8) A>e»di:t|-r^«c0^^x-^$? 

Rr/3^ti: r@j (DL E Dte:^^;|>|gii!)T'~^^*^L. 

3 2<Of'^—^^r)\y • ci/K^v h 3 3 jS^mi ^SaaisIgS 1 4 

(|gl8) ^]iM:;^^frLT«jS'r^r^^:xJi-^ 2 5 i - 

2 5 nX(iXt!-:^2 4XtiL E DtC]]l^j^)Ml±i-ri>o 
[0 13 5] COcfc*9tcLTO.K^y h^g 1 tc:|ol/^T 

u /c e ^w^fTift^ff c ^ Z)'^ T ^ ^ J: -3 tc ^ ^ nr V ^ 

[0 13 6] (3) ^i^tCi£U/c*tgRamS<^^{t 
a4-N^yh^HUi. mXit. mmiS^ re^^i/^J 

[0 13 7] -r^^^. D>1<^y h^B 1 tcti. Mlfflco^ 
:^^^2 0. liBai-fe>+^2 2. ^^y^-trV9-2 1 Rtfv 

[0 13 8] s^«imffl^ofi^j!as^i^*^-;i/5 0ti> 

• D4<^y h 3 3^&/t'LT^K6n^v-r<>DJh>2 3 

(^8) t^h<omn'f-^Km':5\,^xmm(omm\y^)v 
[0 13 9] um.^^m(om^^n'^iy 5 1 ti> 

[0 14 0] 0^^$^Wfflofl^5!lS-tv^^-;U5 2 
ti> /^-^-v;!/- a4<^y h3 S^Sr/M^T^A^n^CC 
D:^p<'^2 0 (g!8) j^^e><OB®'r— ^icS"iJl/^TJilH 

[0 14 1] A^^J-bv^T^^ ^xa>/^— ;l/ 
5 9ti. cne)#fi^saii^>^^-;i/5 0— 5 2<DtB:^j 

iy^y ' ^i/zL-)VA 1 (^11) (OrtWl^^^T^'/l/gP 
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[0 14 2] Sf*Wtc. A:/a-feWT'^^X:n>M-^5? 
^v/'aL-;l/5 9(i. ^^«imfflcOfi^Sas^>^^-;l/5 

[0 14 3] ^Tc. Xti'^^ZyJ'^ ^ysZiy/'^—^^i/ 
:i-;l/5 9ti. iMja4^tHfflOft^SHa^i>':x-;l/5 ICO 

[0 14 4] ^6tc. A;^-t:v>'7"-<^x:3>/^-^^ 

[0 14 5] ^tff^7^Vl'7 3ti:. iiScOcfc^tc. A:^'b 
"T^T-^ ^Xn>/^— ^^i/jL— ;b5 9}^^6-^;^6n^ 

^s^m^amtca-:^^ (4) ^tctjeoT^/^-^^-^M 

[0 14 6] ^LT. ^1t^7=Vl/7 3ti. A;^-fc:'T>7^ 
^ ^Xr3>/^-^-t>>aL— ;l/5 9;b^6^:i'bn^ 

. rj^jsj Rtf rBsjgj \c-D\^^x<omm^mcm-3 
i^T. ^i6^i6^n/c^^/^:^•r^^f®I^cov^To (4) ^ 

[0 14 7] RttWtCti. mm^'f)\yl 3(±. 

[0 14 8] ^fc. .^«^t';1/7 3ti> r#v^j 

-s^g^kecoffl^m^s^M^^^^-ti:. cntcs^LT 

coisidtc^-r^^^keoffl^m^^tg^jp^-tir^o cn 
tccfco. Mlffl^o rrujsj tc^#$nT r?^gL^j (o^^'^ 

40 [0 1 4 9] ^ etc. ®it^T';I/7 3ti:. TH^^V^J 

nj coitifttc**-r^<^t5(kec?:)ffl^m^sitg*p^-ti^o 

;^ - ^ fl;b^^f t -r ^ c :^ ^ o 
[0 15 0] iinhnmcX^X. *Hl^'r;l/7 4(i. ± 

5 9 3?)^8^A6n^^ffll2^$Sm^tcS-:5^ (5) Stc 

50 x^mM(o^ ^ ^ ^ - ^ fii%/^ Wfi^tc ^M*r § o 
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[0 15 1] t/t. *t6^-r;V7 4ti. AtJ-f^>7^^ 

S^cS-:5^/^T. ^a6^i66n/c«l£-r§®t^*?) (5) S 
[0 15 2] ft<*6^tcti. ^tl^-r;!/? 4ti:. t?lj^tf 

[0 15 3] CcOl^S> 1 (D'ii^Wlit. Mx. 

[0 15 4] ^/c. □4->«y 1 OtTl/Jti:. iiIH?b^ 

[0 15 5] $/c. n#^y h^M 1 <73fTlfiti> mmff^ 

^'r<. mnj o/^-^;^-^fii:6^M^>b^'r<^^rc 

[0 15 6] j^^jKOcfc^tcD.t^'y h^s 1 i±mfS,-^nr 

[0157] ( 4 ) y^mmmm 
(4-1) ±i^(omm 
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fi|0^<?)^31cD/ci6tc:^J>:tO^^^^II^^*bTl/^^o D'K 

y hmm Hi. 0 1 5tc^-rc):at£:, mpmm^ i o 
1 . -t >^t5asgp 10 2. *tgitifta5 103. 

[0 15 8] ccx\ "BPmm^i 0 1 ti> g^M^i^m 

^y^-try-t^2 1^) {c^^mm^mtmrnKimrsmm 
mcxti^nrcmm^^m-t^xtimm^ih^mt br 

/ctTiS^. ^^mm^ \ 0 1 :6^1^tob/cA:^1t?B (^^ 
fi^) ^^SSt/OttTlBti-r^HBII^S^bTaHgb. 
tTK^^gPi 0 5ti. fffcti:t#e>n/'cA:^Jlt$B (^^fi 

^) ^^:S-::5u^T. SI^.S^BfiElta^ i 0 4 tCc); D jl^.^n 

/ctfift^-r^RifiSW^isiibTiaftg-r^o ^fc. ^> 

t^SaSSPl 0 2(i. t?y:^tf> 0^b^i/>^»y^-tr>'^ttc 
20 [0 15 9] "^^mm^l 0 Ut. (V^^a4->> 

mmtLrmm-^^o sf*wtcti> ^^^.^asi o i 

[0 16 0] */c. mPmm^l 0 ITti. K#cO^^ 
e^J;^ti\ ^QpfJ (B) tc^b/ccfc^tc. iSSE-e^^ 

^sj-eti. ^M^^x^c^3l/^T^tM14o^gv^g|5^^fffc 

[0 16 1] -fev-y-sasgBi 0 2ti. 'kLy^m^(omt 
40 mn^wM-r^o 

[0 16 2] ^J^ti\ i5(^^^n^I/]i^tC'Ol>rti:. 

[0 16 3] ^i6^^$nTi/^^i*itc0^^^ti> fi?iJA 
(fgA) ^:bT©jf^7b'«iJtin^n^. ^i^-o/cJ:d^^.O 

50 ibnfzm'&<o^y^^i^^^n\.rch^\c^ r^o^ 
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[0 16 4] ^*5. C(D^o^m'f^^7jk't^rcii»(D^ 
[0 16 5] ^/c. Sr^itc^^LTtT^iftf^iOffc^v^b 

T(i. ®j{^gi5 ^mm^^m^(D^it 

fnaj^j-^^pgpri^'y h 3 A-3 DRa'M<*gP^^^y h 
2 CD^}i$Sg|55i'> ^gPo.- h 4&a^fl^<*a5n.- -y h 2 

<^m) 2 5 1 ~2 5 n T^'^o 

[0 16 6] i^mmff^^t^-^ hmm \ oiijf^gp 
[0 16 7] ^6tc. -bv^tsasgpi 0 2ti:. ^s-r^ 

[0 16 8] *:&E1ti!j0Pl 0 3(i. ±3? Lfc«fc -5 
[0169] )i^.^.Si21tgP \ 04it. ±aib/c<fc ^ ^ 

^^^isgp 1 0 K -bv-y-jasgp 1 0 2 stf *ftiitij!igi5 

iBttgp 1 0 4 (i. ( 1 ) SRt/ ( 2 ) ^^m\^^xmm u 
[0 17 0] mtf. asseiEiggpi 0 4ti. -fev-y- 



05) 1#Pj32 002-160185 

mmsi^i 0 2;b^±3SL/ccfc'9tc. -fe v9-tB^]*^e) rtL^ 

f5lB#^i^tiNrr^^tufSLTg^lgiia5l 0 I -h"^ 

[0171] s/c. ^^.^>siHtiap 1 0 4(i. ?^ii^n 

JO Tcmi'^txti'^nrcmnEtiomt Lx^^t^'^^nxi- 

^t^lc(0^. ^(DWii'^tmrnt^^^ry-oi^fX (fgAL 

[0 1 7 2] s/c. }is.s.iafEiia5 1 0 4ti. mm-^n 

/cKj{^gci/Hiai§tc. ^HfeltiftgPl 0 3 >?}>8tb:^J^n^ 

tc. ^(D^dr^mm^i^zf^^fx^'^'r^cti.x^ 

[0 17 3] J;^±(7D<:J:dte:3i^.S®IE1tgPl 0 4 Ci. ^ 
[0 17 4] nm^f&Ul 0 5ti. ^cOcfc'^^ffi.^^.iS 

lEItas 1 0 4 /)^^^tl;^^^n^^Tlft1tfB^i:S•:5v^T^T«I^ 
¥^i^tc^i/-T. oSSSSaiEligP 1 0 4:6'^ "fe-Tt^O" 

comig?b^A:^^n/c«-&tct*. rs£-5^^j /j^e r^o 

o 

[0 17 5] cocfc-ptc. D4<^y h»gni. "^nmm 
^mam^LT. xii^nx<^^^\zm'^^^xvim 

mm ^^M'^^chiS'X^^^o^cr^^o 
40 [0 17 6] m^\i. r^i^oj OiJlf^^^SLT. W 

[0 17 7] ^^m^lit. m\ (A) 
tc. n.K-yh^Hl^. ^^fi^ (^#fi^) i:f6lB#^ 

\^Hmm^m'ik\.x^mm^ii^^^hn^o ^^\mh 
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CO 1 7 8] CtDcfc-^^^^^f'FtCcfcO. n.K«y h^B 
Hi. El 1 etfi (A - 1 ) ;6^e>fpII^Pti (A- 2) iCTsk-r 

[0 17 9] ^LT. a4^^^y 1 ti. ^^'ikKht. 

HI 6tt5 (B) <0 (B- 1 ) tC^-Tcfc-^tC, ^g^tcii 

;g>c^tc<J;0. HI (B-2) tc^-Tcfc^tc, 

^ic^^LfcHi 6 4^ (A- 2) tmur^m^h-^n^ 

[0 18 0] ^/c. ^^-r^lfif^tcoi^Tti. ±a>L/c 
IS) ^|p|B$^i/HiB$F^^&WSbT. ^J^tf. u.t^yh^ 

[0181] ^/-c^ m^\^t. uif.-j vmm \ t*. :iK<r>^ 

[0 18 2] 5t-r\ n4<^y h^gi ti. tTiio^^^b 

-:^r% mmmM\c^K>mrcmm "a-k a" ^wt^ 

[0 18 3] C(Dcfc-9^^^*Sm^LT. P4<'y h^M 

[0 1 8 4] S/c. ±3ai^OSIfigomiT^ti. tTifi^St/ 
C^?b'«T^^o COtf^. i^J^ti\ CCD:^;^^20^ 

[0 1 8 5] ^/c. ±.^<Dmm(Dmmxht. ^f^mmm^ 
^ It ift * u V ^ ^ -tt s c ^ t T # ^ o 



(16) !|#Bg2 0 0 2-l 60 185 

30 

[0 18 6] a>K^yh^gHi. di:;^; (MU(D 

10 [0 1 8 7] 15iJ;^tf> n4-N^y h^Pl;?}^ ^^*v>t(0 

[0 18 8] CT^tf. c:cO<J:^35:tl^. ±aii031^.».e 
IBISgP 1 0 4 7!j^ "B^mm.^ 1 0 1 /O^l^tti Lfc^^®^ 
20 tCjCBUTtfil!lL/c)gS^^-r?T»$£mitf8^> ^^^^ 

r. 3S^.sssBttgi5 1 0 4f)m^Lrcim^t^^mmicm 

[0 18 9] ^fc. n.K^y h^p 1 ti. X:hmmo:)^m 

•r^^^^. ^IJ;^tf. HI 2 4^ (A) ;^t>^ (B) ICTTs^X 

[0 19 0] iii0fi^Titi!:-::5tj- enri/^ 

^iiio:tyi^x^b mm) (oxtjicMLx. m\<o 
X. mi^^Wi^mic^i^xm i ^o:t>^vx^ htci^^tc 

40 (oxii\zn\^x{t. m\(Dnmu9^^h^x'D\c't^o 
[0 19 1] m?i\^t. iKo^or^m-^. ^^mmu\ o 

i^\ A;^;1t$9^tB#S. A;^3l«fS1^H:i#K^'^^Hib/c 

50 m««im¥s^ LTo^ftgei. t^T*P5E-r ^H 3 3 tc^ 
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31 32 

[0 19 2] ^iblC. ^^mm^l 0 Hi. ^7ift*;^Jcg^J ^orj:m^. S-^^^fflgL/c±T'fT'3C^/)^iiMitC3& 

(mtf. $B(8> 13) ^c:S•:5^/^T. mmm^^\^mc [0 19 9] c<D^or^c tf)^^mwm\ 1 Hi. ^1 

^Si:UT(Da^^^-r^c^tc:^§o jl^JBii 1 1 1 1, 1 1 1 2, • • -^fiii^Ti/^^o ^ 

[0 19 3] a^^^^y 1 tc^3tt;g.*:fi0^tc^ [0 2 0 0] iESiJgiS 1 1 Hi. C <0 J: 3 tclt^coljgijgs 

§gi555'to^mcoi>Titt0^L/co :kfrc^mc'o^^r'^^ i i 1 1. i i 12, • • • m&(o^^9immcm 

[0 19 4] (4-2) ffimoi6<^(7)^^ (-tr^^tsan ^iSi^co^^^-r^o 

[0 19 5] n.1-:^y h^SUi, ±aiLfc^^tc. ^t- 20 1 0 5 3?)>^ii!j{^gPO©JSiIft^i: LTai:/7^nS n v> F 

ti. C PU 1 0;b^6O^jem^ (ftSJg^lt^a) tCcfcO [0 2 0 2] ^g^col^T{i:. i1^;^j^^;lTl^^l^m^ 

^^.coT^fe^o [0 2 0 3] m^i£. ^mmmfo-^iL-^'^m'vs>^tm 

[0 19 7] u>K^y hmm 1 ii. cOcfcd^ff:Mc?:>iftf^ iS^n/ctl^. m 1 oiigijtg 1 1 1 1 tcj^UT. iftf^^ 

(A) tcT^fcfcotc. mm^i 1 i^ii;^Ti/^^o cc mmc. ^(ommcmo'^r^n^mm^^^^o 

T\ ismi 1 ui> lai stc^L/c-trv-^-iaiias 1 o e^y^tf. Kji^^^tcfcu^Tf^ffl-r^^N^i/x^iti:. ce) 

2 7bMiScoi&f^^^^-r^/ci6tcig^^nTi^^^'&io stc^"rj;^^c. o>t3J^^p I vu&ti.ri^m'r^is 

S<*fi?iJ^^§o MgiJgRl 1 Hi. #BBgi5^-^^<?)$'JSii ^^^^ffl-rSo ^LT. ft<*6^tcti. P WMSJffll^n/c 

[0 19 8] i:C5T\ n^^-y h^H 1 ti. ^^^tcM [0 2 0 4] 

^•r^J:-5tc;5:^nTl>^V>§Ci:A>e>. 40 [S6] 



[0 2 0 5] CCr% e I ti. 1 TtDoi-^-M (jJ^ 
M^i-) r^fcO. Pg. Ig. Dgti^S(T^D. CcOci: 

•5=5: (6) ^(opm^^m-t^o 

[0 2 0 6] ^^^/^jvxmRzfWii'fcDmnt 



1. V2. V3. V4] t-r^o ccr\ ^^hj\y<Dm 
m^vo. vi. V2. V3. V 4(o smic-^^c tic 

[0 2 0 7] n^^m^y5\^lcWLrct^ (backward) 
Pi&Q'J^lC^n^lfii^Olfffi^bTOi = [0. K 
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0, 0. 0] m^i^£. m\ SlCTn^^oic, 
^gij§§ 1 1 1 1 tc, h;Wii (backward) 
PiRt/[0. 1, 0, 0. 0] «r^;^§o 

[0 2 0 8] CCT. ^fflVo, Vi, V2. V3. V 

Ait. ofj-^Komcomm Q^m^mi^) ^lt^s^ 
oi= [0, 1. 0, 0. 0] {c^^nm 

(Dm^mc^^^^^tLX^^ hJlt"^ [0.1,0.9. 0.2. 0. 

1. 0.3] hV^o/c^3S^LTif en^o 

[0 2 0 9] ^fc. n^^my3\^^cm.rct^\a,t. t 

CO ^ ^ tc L /c / X *i vmiS. L ^ ^ h ;l/ P 2 RZf 
i^JS^n^®){^colf$gi:LT0 2 = [0. 0. 1. 0. 
0] M^T:^r^tclf LZ-ct^tiKi. -^coiittc 

^m{iF(omntLzo3= [0, 0. 0. i. o] 

m^tLXOA = [0, 0. 0, 0, I] ^^^^o ^ 
^ift^t<Olt$8^LTOo = [1. 0. 0. 0. 0] 

[0 2 1 0] fi?ijx.tf> ^^jV7sm<Dm^m i 97^^112 5 

tc^-To ccomi 9rjmm2 5xit. mm^c^mBcoiiL 

[0 2 1 1] ^1 9ti. iL-^^^mictsi^f^^vuxm 

R IJ ti. fifiljPcDm 1 mm (PCOMIP) OfuP. rp 

R2J it. ^(omzmB mo:>mm) (onLm. tfr 
3 J it. ^(omsmm a&Mcomm) (ommx^^o ^ 
fz. rp L 1 J It. j^mm(om 1 mm m(omm) (oitL 
m. rp L2J ti. ^(Dmzmm m(omm) (D&m. 

rpLsj it. "tcomsmm (iS:M<omm) <oiiLmv$> 

^fc. THR ij it. ^mw(Dm\mm (im(om 
m) co&m. rHR2j it. ^(omzmm mcomm) 
(Dim. THRsj it. ^<Dm3mm c^ncomm) (o 
HLmx^y^o s/c. TH L 1 J it. mi^m(Dm 1 mwa 

mcomw) (oam. thlzj it. ^(Dmzmm m 
(omm) (Dm.m. thlsj it. ^<Dm3mm i&mco 

mm} (D&mx^^o ^fz. TH e a d U . TH e a 

d 2 J . TH e a d 3J (i. M/O'^^HSR^^e^ 0 ^tl^* 

ntcWiS^n^fuM^^'ro t:^To!gi2 07^7^02 sic 
itmm tc*5i^T> ^1 5m(o^^;V7.mcom^m^ct 

[0 2 12] it'^^^mc^^^^m^^myjmcm.rct 
ticit. mzoiCTjk-r^orjiJvuTs^trjiO. iLt>^m 
ic:i3\,^xn^^'iky3icnLrct^icit. mz uc^-tj: 
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•^^mic^^^xm^Ty5\^\ci^\^rct^icit. mzsic 

mo^^^icush^xtEm^Wfcnrctticit. mzsicjr. 

mcm-^i^^x. ^^m^mmi^x. iftf^^^^-r^o 
[0 2 13] ^fc. D^tt-y h^m lit. mz etc^-Tcfc 
10 oic. 'R&tf^ttw^gpi 1 z^m^^ctic^o. m 

So 

[0 2 14] mRtf^^m^&i 1 zit. -t^^mm^ 

1 0 zt^ib(D\i!it}icMLx. ^^i^^t^^^m^^r^m 
mo:>mo:>mm^-r^o tvx. ^mcmcxnmmm^ 
mtj-t^o m^i£. ^Rzf^m^i^^i 1 zit. mm^e 

m^i£. n^^'i^^ji^icn-^ntc^. ^^tnwu. 
20 X. m^^mj icm^'t^nmmm^mt)'r^o s 

m^±ifibnrcib. ^^trnm^x. \'^Lt>^m^ i^m 

mt. 9is^t^ib(DnMf^'^±'^<. ^mtm\:^^ctic^ 
o^m^n^mi'^x&^o cco^r>^^'ummmicm'^^^ 
30 xnm^f&s^ 1 0 5 irim^^f&t^o 

[0 2 15] CCD^oicmi'^^^m-^'^^CtiZ^O. 

m^^<Diimic^m(om^:^^^^ti^mic. 
rcti:^.-yhmm\itsib^^m^m^L. cco^om^m 

[0 2 16] rsts. ±^Lrc^^^smi'^(D^witm^^ 
^ii^. m!^t.\.x:!K(D^'^r^^mic^K>'^'^ms,'^n 

So 

[0 2 17] x-nmxit. ^mxt}m\cn^t>^'^nrcmm 

mxit. Xt]m(0^:^zL — uyf)^(bB^hnrc'r—^(0 

it. xt}'f-^<D{^ibf^^(D^micmmi.x. ^(o^mm 
^ttmbTSffi-rso tLx. ttit)Bit. ^rsmo)^^ 
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[0 2 18] ^fc. mXi^£. ±aiU/ccfc'9:^3ScO-^ 
T> Oi= [0. 1. 0, 0. 0] 'h'^Xti'^-^r. mti 

tLx [0, 1. 0. 0. 0] icjfio^ffl ff^mti 

[0 2 19] i:JL±<D^^itCLr. u^K^y hSB 1 ti. M 
[0 2 2 0] 

(4-3) n4<'y h^gtC#;^^n/ci1^^3^0^S 

^y h^gi It. m{c-^^^n^9\t}^^^Lr. 

[0 2 2 1 ] a4<'y Hi. nti(0^mcorcii>(Dm 

1 5 1 ^mi'!F'^^^rc^(omm^ \ 52t. 
gi5«i 5 1 ^ifrLx9it)mmi^r\^^^mm^i 5 2(d 
««g^<^m-r§«itti^a 1 5 3 i:. «^tB#is 1 5 s^'^i^ 

thb/c^liigpi 5 2<Dt*cfiii:n;^^^?^fc:;^-t±T^^-r 

isgpi 5 2cDt^»/)^e^toa3s^it^'r^ci:*^T*^ 

CCX\ ifjf^gPWl 5 Hi:. Cc:T\ a^^^y hSS 
Hi. H 7 Rt/lil 8 tc^-r J: ^tc. fl|^f*gp:a-^y h 2. 
ffi]gpn.-^y h 3 A, 3B. 3C, 3D. Pf4:gpa.- *y h 

2SD^^g5a-'y h 4m(DT^^zLDL-^2 5 i ~2 5 

n tctoTi^iifj^n^gp^i^-efe^o s/c. giiiiasi 52 

^£0cfc-9^r^5^:iX— ^2 5 1 ~2 SnTfeo 

T> ai*WtcCi:. r 2 5 I —2 5 n ^^fiE 

[0 2 2 2] C(O<^'?rjimf&t^^CtiC^0. n^K^y 

-yh^BUi. ±)£eL/ccJ:atc. BHf*gi5:i^'y h 2 . p 
gpri-^y h 3 A. 3B, 3C. 3D. flHf*gP:i-^y h 2 
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St/^gpnu-y h 4l?7b^Mii1 (>?3^>h) ^ifrLtcW) 
fta5«^:$n. ^5>tc. Pgi5a.-»y h3 A, 3B. 3 

c. 3Df)mm(omB mmm. mmm. &Mmm) ^ 

ttfefitC^n-rtlKIgPJX- ^y h 3 A, 3B. 3C. 3D 

ff^mm^fn.xm^'^n^tmc. fflf*gi5:x-^y b2cD 

/O 7'^^:xX-^2 5 1 —2 5 n iCcfcoT^H/S^nr^o 
-2 5 n ;^1#^UTl^§^-^tC^A6n^fg^T& 
[0 2 2 3] P'^M(D/^;VXiE^(D^(D^E(Dimt. Kft 

gp« (Sa:3.X'y h) 1 5 \ ^ftLxntim'^mLx^^^ 
SBIIilgp (^-^) 1 5 2 0«^lc^oTi*^^n^t, 

^y h^BUcAP^§i^;^tcfitoT:^t<J^^o a4<^y h 
t±c:cDcfc^?5:PWMa>/^;l/Xf|lOfii^. ifil^gPW 1 5 1 

^in.xnt}mmi.x\.^^mm^ \ szcDV^mtvx 

30 ^(OX$>^Cti^^ib. l^tB^Sl 5 3 7b^«^tH-rSB8Ii1g|5 
[HlgSi 4c7:)-«ii6^LT^ii^n. xtiv:7h'>xr^ 

[0 2 2 4] CCT\ ^BScOJBS-eti. f^TS^ait- ^ 

7b^ ir|.;f3cD^gffl£OPWMtO/^;l/X{g^i:LT. Pgpri 
:=-^yh3A. 3 8. 3C. 3 D(OMtn^ ^tc^ 
x.^n^ PWMco/^;l/XfH^i:. fli<*gP:3.:^'y h 2 
40 g|5n-- 'y h 4(OMIi1^3&;5^-^tC^x5n^PWM<?D 

^N;l/XfI^^^^5fflbTV^;g,o ±3iEb/cll] l 9-^2 5 

tcisEffl^n^^MSlgP (^-^) <DPWMO/^;l/XlS^ 

■Tj <o^.co/^^->i:^2 uc^-r rftT^tclf-rj co^ 

;I/XitiicOft;b'^0 (xlfi) tcoi/^TBSW^^^oTl^^o 
[0 2 2 5] il^t^^O^^T'ti. ±aiL/c<fc^J&^^^n 

50 tiffim^rcm(DC(o^o^^^^-y mL<(ft^^h)v 
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[0 2 2 6] -^-^^l/^^^y bV-^^LTs |5gS*S'& 

rsm) 1 6 2SrftH;^Sl 6 3aD3®?b^e)^^3S^^'y 
[0 2 2 7] c:OcJ:-9^&3^>'^^y^7'n/^y— >-3 Vtc 

1 6 1 icA:^^n§^. i e 3f^^ibt(DX^rj:^ 

[0 2 2 8] ctDct-^^SS^^^y ^:/n/^y— >3 

ct;|,r:^-^;l/:t>^^y h^y-^K^f^f^XtlM 1 6 K 1^. 
nm 1 6 ZRtfttiJ-jM 1 6 3timf4:6^tcti:;*cOJ:^tc*ll 



Iinput= 
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* [0 2 2 9] Xtim 1 6 Hi. mWL<0:^:x-u-y:^mi. 

T*50. ^^(ommr^frti 8<ao^^-n>^^brv> 
So ^^^-^^ A;^g 1 6 1 tcti. n;^co^^co/ci6tc 

Ci. m^(0^$^tLX ra:-^^^ (standing) J > Tffi 
(:l3i^t)^^. Sitting) J . r^i^^ (Sleepin 

g) J ti^-ofzsmm&o. (^^liiaso 
•t-^) copWM/^;i/Xi|i60fii*M sffl® (4Px3 = 
1 2«JB^WgI5tcti33Sll;b'«fe»9fH 5@3S) thK>. C 

[0 2 3 0] ccT\ faffi£O^I5coA:;^^^>i1';^iO^^ 

[0 2 3 1] c^oJ:'9^A:;^i^ 1 6 uc. 
A;^{fiT'fcS^^>'^Xit'McOffiti. [-5 12, 5 1 2] to 

So 

[0 2 3 2] 
* [^7] 

• - (7) 



[0 2 3 3] CCT% Pti^S'J^nro^^/bXtfSOfiitF'fe 

Pm a X tiSAfS (5 12) TfeO^ Pm i n (iS 

/NS (-5 12) T^^So ^fc. m^\zmi.Xo:>Kfl'r 
-^ti. [0, 1 ] iO/c:*?) (OXti 1 30 

[0 2 3 4] l e 2ti. *g^(0^:i-P>^WL 

numOflnput-t-numO fOutput , _ 
numOfHidden= ^ ^ f-c 



^W:^^ 1 6 3 0::iii-n>f?:)gfc<h:cD¥i^^^*:>. 

yjitcJ:^^.*!^ 1 6 2 0:=.i — a VISnumOfHidden 
ti. xSTat"^ (8) ^(O^oKt^^o 
[0 2 3 5] 
[^8] 



= 14+a 



[0236] CC-e. numOf Input 1 6 1 ol 

— DV^ij-t^feOx numOfOutputtitb:^!^ 1 5 3 0—^1 — 

So cKD (8) ^tcA:/3® 1 6 1 (TD-^-aV&numOfl 
nput^LTlS. tgaiOm;^}^ 1 5 3C0^ji-n>S(nu 
mOfOutput^LT 1 0^&f^A-rSi:> l§n® 1 6 2^0-^ 
zL — civiSnumOfHIddenti 1 7tc^So 
[0 2 3 7] ^f}m 1 6 3^i:. ^fi^co^^- u b 

So CCT^tB;^® 1 6 3<0-i-a>a*M 0<Bi:feS 



(8) 



cnti. 1 oajioii^:/a^^^tcj:oigis-rsc^ 

i)^X^^Ct^7jkm:\^. m^f^£. mcW^nfc (Forcer 
orward. mz 0\C7jki.rcnti) . ?tStc}f^n/'c (Fore 
eBakward. 02 ^c^^b/c^:^J) > fi#^^/cn/c (Ri 
ghtHandUp. 0 2 4 (c^ L/c^:^) . ^t^^^/ctlfc (L 
eftHandUp. mz 5{z^.LrcnM . m^^mcnfc (B 
othHandUp. ^^=&U) . ^^±ti:W;?n/c: (HeadUp. 
mz ZlCTTsi^fcntj) > Eg^TlcW^n/c (HeadOown. 
0 2 3tc^b/ci^^;^) . m^^^cWtEtlfc (HeadRigh 
50 u mTskrsU . m^m^W-Stifc CHeadleft. 
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t) . ff^nn^^l^ (NoForce> <?l]^tf ^9 (Ctj^U/c 

Vim) mtLxi omm(D9\^fj^mm'r^ctti^x^t 

[0 2 3 8] CCD^^^cXtiM 1 6 K mnM 1 6 21^ 

tfttitiM 1 6 3f)mf&'^nrt5 0. mnm i e z&t/ffi 

fflLrv^^o v-y^-f FPSti. WJx.tf. ^3 Hc^-r 

:^l % a6 6 3bHC ^ { ^ itt ^ ^ b T ^/ ^ S o 

[0 2 3 9] ct?DJ:^:^3g/^^v^7'a^^y->^3 >tc 

[0 2 4 0] ^^ti. ^3 OtC^^cfcotC. Xf}^^ V 

(1) 



(21) 1^ga2 0 0 2-l 60 185 

40 

[0 2 4 1] c(Dt^. ^rsm 1 6 2if^xt}^\^^om 

e>n^tib:^yj ^'Mi (9) ^\tC7fk-i£n^^^^iyif 
^^FPSsigmoid 0 cfcr^Ttf^n^ Sfc. tB;^J^ 1 

6 3>^^A:^?aic^0t#e>n^tti;^y j ^2)^^(10) 
^tc^^n^cfc-^^S^^^^-r FMiSsigmoid O J:oT 

ti. (11) ^tcJ:oT:^$n^o ccr\ i/^^-t^K 
BBiSjsigmoid O (1 2) ^OcJ: 9 n^g|gi(-e 

[0 2 4 2] 
[IS(9] 



j 



= sigmoid ^ 



nu mOfln put 

2 Wi 



) 



(9) 



CO 2 4 3] 



y nm nOIH B 

y _ (8) =gigjnoid f S 



20 



mi 0] 

-0) 



) 



(10) 



CO 2 4 4] 



[^11] 



(11) 



[0 2 4 5] 



Sigmoid (x) = 1 / [l + cxp (- Jf)) 



[S!(l 2] 



(12) 



[0 2 4 6] cctF\ a i tiA;^^n^&^^;^x*icofii 

[0 2 4 7] ^LT. mnmo:>Xil^^ h)l^'r-^(OX 



numOtOutput 

[0 2 4 9] CCr\ al,±Xti^^ hJ^T'—^T-S}^. 
[0 2 5 0] ^^^Ulti. ;?t->^^>^^ 



y h'y-^icxti'^nrcxt]^^ h^vr'-'^tm.m^'^ 

h JV'r- ^ t (Omm^&^ I^IBJ;^TtciRm L/C t 
^mj-^^o ffiJACi\ (13) ietc^^J;'5:^¥1^2Sfe 

[0 2 4 8] 
[ISl 3] 

• • • (13) 

[0 2 5 1] 03 2tc{i. ^^mmtW'i^2mmmt(D 

^lHlS(^^*^5 OmX±^o:>W-^2mmMffm^\^^crj:r:>X 
4ot). cnti. ^g3!)^S^5 OlHlT'lR^LTl/^^C^^^ 

50 S35:oT<^o -r^tJ-^. WS^fiilCcfcoTti:. C<D<fc^ 
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[0 2 5 2] UicOcfc-p^^HtCcfct) ^yn/^ 

< ;?j T- ^ -tf- 3 > ^ nx V > ;g> :6^5;b^gci/ ^(i 
[0 2 5 3] Mf*6^tc:ti> ccOcfc-^^il'^^co^^tCci: 



(22) 2002-160185 
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[0 2 5 4] :^*5. CCTti. ^Ma5tC:font ^^^^ 3 
P;^tf. SVM (Support Vector Machine) ^ffl 

•To 

[0 2 5 5] ^^^->mm(ommi^t. -rX 

3^;l/X= (x 1 , X2, X3, • • • Xn) L/c 

m^icni^r. (1 4) xCJc^-r^^MSt f (x) 

[0 2 5 6] 
2(? [St 1 4 ] 

• • • (14) 



[0 2 5 7] ccT\ m^'^^J\^^y = (yi. y2, ^i^o 

y 3. • • • . y n) t-r^t. (15) ^CDcfc^^M [0 2 5 8] 

f^^n(DTr\ II V II 2 ^g/jNfb^^r^ffl^^xnt^a m\ si 



[0 2 6 3] [3S18] 

max I a, - ^ r a. a . y . xT x. 



(15) 



[0 2 5 9] CcOcfcd^M*^cOOl/>/cfp5Sti:. 'y^^'yZ/ ★'T^^o 

v>'zi(0*^^t!iJS^ffii/^rft?< C^^^T'^^o '^^'"^>' [0 2 6 0] 

v^:x^a^3»A^^^. (1 6) aSiO<fc-9tC^-rCi:*^* [iS 1 6] 

L (w.b.a) = i I V r [y, ((x- V . b) - l)) 

[0 2 6 1] dCT'. bSt>*vtCOl/^T ( 1 7) ^tOcfc li^bTl/^^So 

dtcHm^i^'r^^. ( 1 8) ^tc^-r J: 3 J^~^j):H-lljPp1 [0 2 6 2] 

m^mh^^hiS'X^^o (1 9) StCtiSiJI^^i^^^T^r [SI 7] 

4i^«4L=:0 • - • (17) 



(16) 



(18) 



[0 2 6 4] [3S1 9] 

:«,*0.2«,y,-.0 - - - (19) 



[0 2 6 5] ?t85[^r^<0^*7tS;b\ g)ll^-9->7';l/f7Dg5j^ [0 2 6 6] 

^ t>^>^i^^^ti. X^^y^^lSf ^O^ISAbT. SiJ [S20] 
(2 0) ^Ocfc^tC^^-rSo 50 



(23) 
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(20) 



[0 2 6 7] gS{ktCOl/>Tti. (2 1) ^(OSWSaa * [0 2 6 8] 
^&g5Sfb^§o * [gi2i] 

[0 2 6 9] cti. »^^^{4^^^'c^-e^^^ 

'yf'^yi^zLm^aKmt^mmi^t. (22) sco 
jz^tcT^-Tcfc^tc^M^n^o (2 3) ^\atmmfk\^^io 

maxS: a, - J a, y, x. 



[0 2 7 0] 
[i!c2 2] 



(21) 



(22) 



[0 2 7 1] 



[2 3] 



(23) 



★^^ifi^ic^^^o ti-^^)\ymmt. fe^^^o^ffli/^ 

T. (2 4) SiOJ:'5tc^-rc^:6^T'#§o ^UT. 



[0 2 7 2] L:6^L. CC^TTti. #fajgtOP«1S^(S 
;l/^S(K (x. x' ) ^»AL. -Sffi^^TtO^P^tc^ 20 g'Jg8S(ti> (2 5) Stc^-Tcfc^tCJ^^ 

mLx^(D^rsvm^^m't^ct^^^^o co^^ [02 7 3] 

ChtCcfcoT. 7ncD:^^7c:Tii. ^fSSfe^i^gl^bTi^^c* [^2 4] 

K (x . x') = * * (3C') 

• • • (24) 



[0 2 7 4] 



f (O (x)) - tl» (x) + b 

= 5:ci.y,K(x,x^) + b 



mz 5] 



(25) 



[0 2 7 5] ^mcmi^rt.. (2 6) ^ic^s-r^oic [0 2 7 6] 

=^;g>o (2 7) ^^Cti$lJSi^^^^^.T^Url^^o ^ [g!(2 6] 



[0 2 7 7] 



maxZ a. Z ct. a.y. y. ic(x. , x.J 



SM»*jSb« : 0»scl,-:C.2c«,y,- 



[^2 7] 



(26) 



(27) 



[0 2 7 8] :^-^^;b^ifc^LTti. >^:^7-:t> ♦ [0 2 7 9] 

(2 8) ^m^m^^^^Ctfj'^Tt^o ♦ [8i(2 8] 



(28) 



[0 2 8 0] J;^±cOcfc-9^/¥.atC^i9> SVMtCcfcSR 
[0 2 8 1] ^fc. CCTti:. n^K^y hSMl ^^v^H-f 



50 



^m^Sl 5 3T$>'g>o 
[0 2 8 2] C(Ock^^a4<^y h^g Hi> BlliSgPOV; 
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mhri>mrcrj:mf&^m^ ^ c <b < ntico^mf^'^mfS. 

[0 2 8 3] n^i^^y h^H nc*5Ct^COc}:-9^ 

[0 2 8 4] ^Tc. ^mXi^t. nti(0^^m(OPV^M<D 
v'^ybXfl^^LT. ffiJa5:3.n«y h 3 A. 3 B, 3 C, 3 
D OMIR jS: § ^ tc ^ P W M CO/ X 
i:. BHi^gp^^^y h2i:ligp:3.-*y h4 0IIIfi^^^^ 

[0 2 8 5] t/c> ^mXit. P\NU<0/W7sm^^n 
[0 2 8 6] 

( 4 - 4 ) ^^m^(DmM (i^pmM^(om»m) 

•y hss Hi. 1^ 3 3 tc^-r cfc "5 tt. ^^m^^mmt 
^^^hi.x. ^^\mxt^m^ \ 2 K mmmmm^\ 

2 2. HMMglSl 2 3^{i^Tl/>^o C C T\ ^^MBtt 
UjgPl 2 2RtfHMMgPl 2 3 ^1 5 

[0 2 8 7] ^m\mxti^\ 2 1 ti. mm(o^mi:i'^x 
ii-^n^u^x^^. m^^t. ±^oT^^D>-^>2 3 

^fi^) ti. i^mafflaia^i 2 2tcH:i;^j^n^o 

[0 2 8 8] I^SiftfflmgP 1 2 2ti:. ^#(i^O^$SJ[ft 
[0 2 8 9] HMMa5 1 2 3ti. Hidden Markov Model 

^jgfflL. mwM\^m-3\^^x. Kti^nx^rc^mim 
<o^^x5i^ja^-r§o m^^t. wsL\z^m^nx\^^^^ 
■^x^cs-:5i^T. mmm^^mm^^o ^lt. hmm 

[0 2 9 0] tX±cOcfc^^*g^tCcfcO. a.l-;>y hSSi 
ti. v-r<>D>1->>'2 3^;b>6A:;^^n^^^^^gg^?iJ 

[0 2 9 1] -=eLT. ^3 4tC^'rcJ:dtC. ^f^^IESP 

1 0 \\c^K>Huu\c^K>mm'^nrcmm(omn 

[So. Si, S2] -bVlflgMgPl 0 2tC<fct)^ 



(24) 2002-160185 
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^#b/cift^t^01«$B [Vo. Vi. V2. V3. V4] t 

mmmm^msM 0 4tcA;^^n^o 

[0 2 9 2] aSffletaiigP 1 0 4 T'ti. ^g^tC^V> 

1tf8 [Bo. Bi, Bz. B3] ^&^f}-t^o 
[0 2 9 3] m^^t. ^^\C^\^^X. 0 3 5tC^-rcJ;-5 
tc#^|giSSgSi:LTtO "*3-rt?0 (backward) " (Om 
10 %^h. ^Tifi^DB^^#t^:c^;^^gS^LT-<^ [0.1. 0. 
9. 0.2. 0.1, 0.3] ifX-)l^nX\^^^m^\c^\^^X. ^ 
Wik\c^ "^-tt^Ki (backward) " t^Xti^ntzh^^c 

ti> r^5iffiDj [0, 1. 0. 0. 0] ^^iimm 
[0 2 9 4] j;^±. a^c^y vmm 1 

CO 2 9 5] (5) ftlRiajS 

^ 5 /-ci6£0$ij^^^^ * -y- S c i: t J: !3 pItE i: 

CO 2 9 6] Dd<-y h^S 1 a, «|HiaSOfci6^7)1lifiK 
50 i: LT, 0 3 6 ic^-r J: o Jc, H^ft^X:'^^? 1 3 K 

1 3 3^{iK.Tt/^S„ CCT'-tr^V^T^— ->3 >SaSg|5 

1 3 zisctf^^^rnvBrnmrni 3 3«. ^mnrnva^m 
40 CO 2 9 7 ] iffl^ft^A:^gi5 1 3 1 a, mm^mi^-r^ 

OT'fe-S. ccDiii^e^A:^a5 1 3 i A^^A^'aSnfciii 
[0 2 9 8] -tr^V>-r— >Sa]Sa5 1 3 2(i. MB 

50 >'r-i/By\c^K>. mm\^rcmm}H\c^\^^x. ^s*t 
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[0 2 9 9] ^^mi^l^ttigPl 3 3ti. -t^^^^T^- 
[0 3 0 1] ^LT. ^Olf^^^^iiMLT. a^.a 

[0 3 0 2] m^\c^^^'^nmn^^'^'t^^tK-D 

[0 3 0 3] ^^**^%H^tBa5 1 3 Sti. 1t^Ml|Sc^3fi 

[0 3 0 4] CCO^fc^tC. ^SJ^^JI^I^mgPl 3 3^i. 

•tr^Wr->^3 ^ja^gp 1 3 2tcJ;oT^^^«ii^tca 

[0 3 0 5] &L±<o^orj:mmm^xii^i 3 1 > -t^* 
^ ^-r- 3 ymm^ 1 3 2 Rr/^^m^^i^mgp i 3 

[0 3 0 6] cntCcfct). D4->^yh^Sni:x 

[0 3 0 7] ^*3. ±j&(omm<ommT(ft. a^-^^y 



(25) l$ga 2 0 0 2 - 1 6 0 1 8 5 

48 

[0 3 0 8] ^/c. ^^m^itc^tf-^^amti. mmic 

0> frfc^fiJigi (lij^A;^;. #I^A;b) ic^l.r&M^ 
[0 3 0 9] *fc. aSc^fAo/cB#;^>*ex-r^yy±tcA 

[0 3 10] cntccfco. am^&oTi/^^j^^ (**^ 

x^y >^±tc:^^^fS^^n^Ot:\ cco^^^i^com^ 

^JR L /c ^^<?DilS ^ ^ ^ c ^ Tb'^ T ^ ^ o 
[0 3 1 1] ^LT. 3EgifiEaiC^fAoTU^^**^^0" ii 

30 [0 3 1 2] ^fc. ±t|pia]tti. $i]St^LT^Sm^^ 

[0 3 13] caD<fc9^«|p!a.^.^ti. 3l«<OA^AO 
CfDig'&tCti. -t^'p<>7^->^3 vtc<^OiS/cm 

^<Dmm^^mmmt\^x. am^fc^o ^375^^1/^ 
[0 3 1 4] S3 7 * (A) itCTfk-r^oic. &^mmitc 

40 ^oV^T. RIti* 1 4 1 1 4 2 tCcfc Dtgb^bTV^^ 

[0 3 15] ^LT. H^rtJC^SttSflflfeaJ^J-^tfe^^ 

0. ^3 7't» (B) tCTj^-Tcfc-^lc. ^1 4 2 Og|55i'*'^t6 
[0 3 16] ^LT. 13 3 7 4" (C) tc^f ^ 
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[0 3 17] ^LT. ^3 7 4^ (D) \Z,7r<t 
iii^ti:^i6/cfi¥7a(^^^^H^i^^. 113 7 4' (E) 

[0 3 18] Src. «[W|aMtcov>Tti> ±^EcDcJ:^^ 
[0 3 19] ^fc. a>1?^y b»g 1 *^tt|pia#,^?ToT 

[0 3 2 0] U±<0cfc9tca4<^y h^g 1 AP^i:-r 

[0 3 2 1 ] Sfd. a^n^^y hSH 1 ii> ^<?)tTSj^^^ 

CO ^ ^ f f ifi ^ m ^ ci: 9 t c ^ ^ -r ^ C ^ T # ^ o 
[0 3 2 2] ±a^Lfc]^SfB1t>'XxA(OMi*^y 
tCOV^T. E13 8%#»gL^:^^eifiB^'r^o C(0^3 8 

T. fe (Color) ^l?8g2 0 K (Shape) UW^Z 0 
2. (Speech) ^,^§§ 2 0 3 co^^^ >':t^;l/CDA;^ 

(Mhmm ^f^LT^D^. &^.Mt5 2 0 1 - 2 0 3T' 

tiA:/7>'^^->?b'«cn6^oi^'rno7'a h^-ry^cw/s 
•^n-^*nm:^jb. ^^Js^>gP2 1 oco^a^fBtia5 2 i i 

tciM^Jc-^tcbTi/^^o CCT% (Speech) 
2 0 3;5)>6«Otti^jti. igf*^35C}itcaeo/-c^>/mt^fT 
5-lr-^>T-'i' • nv/^— ^ (SO 2 0 4^/VUr 
^^^ynh^-f:/! D:6^^S3HE1ta$2 1 HCiM^n. |5| 
Bttc^^lB^^J (Phoneme Sequence) '£>5SWfE«gi5 2 1 



(26) 1tgg2 0 0 2-l 60 185 
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ncjxen^o ^fc. *^tcBiLTti. *Hgit$sa5 (i 

SM : Internal StatesModel) 2 0 5^^6ti:*Hg (B^J^ 
tfW^cO iO^ikfii (r'^l'^fii) A^r^o^g^LTtb 

;^^^n. »^JEiggP2 i oo^WHEitgP2 i ucSl^n 

[0 3 2 3] a^JEtiSP (Associative Memory) 2 1 0 

ti. ^WfBligP (Short Term Memory) 2 11. SS^IE 
iggiS (Long Term Memory) 2 1 2 Rt/iiMfBISgP (Atte 
ntionMemory) 2 1 3 LT«l^^nTi/^^o ^6 
/O tc. ccoaSfEti>^X7^i:.tc:fei/>T(i. ®RBIE1SgP2 1 
nc^3lLT. U U-X;^;^:=-XA (RM) 2 2 1 J^D^ 
Rift (behavior) ;t^^yh'7-^ (BeNet) 2 2 2 T^j^^tt 
6nTV^i>o RM (U U— X>^;^7— Xi:.) 2 2 iRt/B 
eNet (?fii!j^-^v hV-^) 2 2 2 (i?Ti!l^fiKgP^ t**^ 

[0 3 2 4] CC0^3 8tC^-rffl^JE1ti^X7^AtC^5V> 
T> 'feM^gg2 0 1 TCi:. tr^V^-r-v^a > • 

^hti. feynh^-ryi D^f^j!in^nTSSJBtigP2 
20 1 o\zx-h^t\^^o 0 3A^e>(i:. a.-+fco 

f€iSOg^iB^?iJ (Phoneme Sequence) tji^JEti 

35 2 1 otcjM€)n^o cntcj:-:?T> IE1S • Mfflojas 

fz.^=^^y^-)\y<r>'mmt^ wmmu2 1 oi^coswie 

ttas (Short Term Memory) 2 1 1 tclfM^n. fe^— 

^coB#ra. 1 0 o:t:/>^xii7 b^ga[«#^n 
[0 3 2 5] mmm^z 1 oTti. xti^^^-y\^m 

30 LT. 3g£tcfE1ib/'ctOTfeSA^i:'5 3b>31ff. (recal 
I) -r^o )l^>:6^^RJtg^iS^ti:. A:^/^^->^^^0 
^^U U-Xp<;^-Xi^ (RM) 2 2 1 SmTi/j^-^y h 
y-^ (BeMet) 2 2 2 tci^fgi-^o iffi^.njfll^il'a' 
ti> 3aMcO:??r^^{>tj[lPbTRM2 2 lRt/BeNet2 2 2 

[0 3 2 6] BeNet2 2 2 T ti. fe^.iJE§§2 0 1 (Dt}"^ 
— lr^'^>7"— i^a > • ^ri^^— (Shar 
ed Attention Flag) ^5^x^y^b. ±3? b/c J: -9 
- 1f ib (Omm L^tc cfc ^ Jt|5iaMcOWM^ -y ^ a V 

40 vFtc^^uT. affi8Eisa5 2 1 otcjMfif mmm 

1SgP2 1 OTii. BeNet2 2 27()^e5'^y^:3WK^^ 

;g);^-':/>>x^ h^a.WJB1ta5 (Attention Memory) 2 1 
3tc1S)f«i-§o <lc04*fl8T\ ^tEO^^bfi (-r/b^ffi) 
^"«+5j^A^Ctnti\ riMfBltgP (Attention Memory) f)^ 
6 2 1 3fiWIB1ta5 (Long Term Memory) 2 1 2^0IB 
1g (memory) ^fT"5o *HE(0^{tfB (t^;!/^!!) fri. 
;^tfO-l 0 0(DJ:^^r^n^'W^fg;&^:5C^;6'^T 
2^gg(Or';l/^fa^fflJ:^(f8 0TiEtiLr4ottti\ jS 
50 StCcfcOS 0^l/^^<l*t#§Ch;!)^prtET^§o 
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[0 3 2 7] :klc. ffiSIBtio^iatcov^TIKB^-r^o 

ti. m-m^Xtim (input Layer) 2 3 K muS^ 
m-^m (Competitive Layer) 2 3 2 tir^m-^^^^- 
y h»7-^(7)M^^bT*3t>. Xtjmz 3 1 corn i 
^yh (-3L-a» tg^S2 3 2C0|g j 

m.'e-h^tmm (^^vh^^.®) ^-Kco2^:-F??fi 

^^RrS:^m(OXJl XI, X2 xm tCj^lSL 

^^n^*n2 offl^oi:L. *tEoa$i^6<i^i-rsi: 

Xti^:3.-a>mt. 2 0 + 2 0 + 2 0-1-6-6 6 
. iBttT ^ >' ^ V Hi / ^ ^5? - >^c0^tcll b 



52 



nu mOfln put 



*fflja(?)^TOm^^t)"li:/^^~>7b^ 20X20X20 
X6T4 8 0 0 0^i&^;b\ <5lJ;^tf 3 0 0SJe^^^*r 
§ C /)^We>n§o 

[0 3 2 8] ^^tc. lati^-FtCOl/^TlKB^-r^o A;^ 
® 2 3 1 ^gg'&a2 3 2 ^tOfS^fi^Wj i (i. 0/)^6 

70 ^ — F;U [X 1 , X 2 Xn] tCOl/^Ttix 

CT^tf^^-nvx 1 tcJ^^S-r^yn h^-ry I D (CT 
Atf^ 1 #@^0fe7^u F^5?^y 1 D) ;bW.iS^n/ci:^ 

ii- 1 (DM^t^o 

[0 3 2 9] mt3 (SS-^) -:x-a>yj (7)ffiti. A 
:/j{PJj^O:=-zi. — aVx 1 tcol^T. ^^(O (29) ^tcj: 

20 [0 3 3 0] 
* [382 9] 

. - . (29) 



[0 3 3 1] ^fc 



(x 1 -Wj i ) 



a : m 



max {y j } 

[0 3 3 2] gg^^^:^t»ffit^;rc:^:z-D>' (winner neu 
ron) ^A;^~:i-a>^OS^'&(0S»fti:. Kohonen (D 



W„ (new) 



Wj 1 (new) = AWj i -fW j i (old) 
\c^OM^^^o cn^L2NorinT*IE*IftLT. 

0) ^^-rsc 

[0 3 3 3] 
[^3 0] 

' • • (30) 



:k(D (3 



[0 3 3 4] cco)^^:^*^v^t>*^§¥SO?i^^^b. 

[0 3 3 5] CCT\ ai*«^J^bTti. ±ia^W^a = 
0. 5^ffll^T*3t). -jgtHlt^-iirntfSai-r^cliiti: 

0 ^ ^5: < iB1i b /c/ ^ ^ - ^^jS.^.'T ^ C ^ Tb'^T^ ^ ^ o 
[0 3 3 6] rs^. ii:^^Wtc^^^-ii:Ti/KjiS 40 
T\ li^leIgS(co^i/v^^->te:MbTti:iati;^?b'«3S< 

<^^<fc9^f±ffl^?^)'^3i^Jatitc*fbT*i68n. *^ 

^^asfB^io^^--:^>y^CcJ:owft^T'^. m^f^i. 



IBti:^^fei/^^VHc;^0. HBtib/c0^ti:aS'9/^^- 
o/ct)-r^C^*^Sb^o /c/Sb^ ^O^. ifrbi/^v'V 
6 nx V ^ T ^ ^«X^M^>lB1t X 7^ i^^^IlT' 
[0 3 3 7] (^S) ^-Ftcov^TlttB^-r 

i>o V^S. ^^Atl>'^i$?-->^^ h7l/ [XI,X2 

X n] ;6^ilcD^»JB1g>^X7^AtCjS^^n/c:^-r^o 
C(OA:^^^ F^Vti. T'a F^-TT" I DT^^. >^a F ^ 

T. ±fiB (2 9) ^\C^K>%^n'^n^i:)\ ^^^V^-^lV 



53 

max {y j ) 
Y=W • X 

X=W- 1 • Y=WT • Y 

[0 3 3 8] Xtf^^^-y'COmTjk^^tf^^^M 

[0 3 3 9] Ccir\ ^4 0ti:. &^Xtl^^'^ — >ffCX 

iL — n ^^^^^-^(TD^^ (active input) Rt/fiiAcUT 
A:^^ ^ ~ a > ^ SS'&S^O:!. :x — cOSg-g-co 
(non-active input) tc-Ql^T. ISffi^H^lil^if 
(epoch) . Wm^:='=L-u>^!km (activation) t 
LT^LTl^^o CCO@4 0J:0. active inputcD*!^ 
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^/}^^;^— rtc^So cn^tiWMWtii^ non-active I 
nput A:^!/ ^ ^ - V T'fiiAc bTV^^l>-a.-uv 

[0 3 4 0] J^4b\ }l^[H]$!(0^-e^<s ll*MJg^># 

It L/c^^jatii^x-r A%itis-r s c ^ we>n§o 
[0 3 4 1] ccx\ :^nmmm(omwm\c^i^r 

^c^t>oj^-efeD. ^/c. llfiicOi*46^tcMbTt*^ 

[0 3 4 2] ^i5(coA:^^^^->^c^-rstC^tc 
Ol^TltiB^'r^o <i>^?^/^^-y^A:/3^ bTllTj^b/c: 

*g^^^^c0S 1 tc^fo 
[0 3 4 3] 
[ai] 
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56 








Ml 


18% 




1 


1 


1 


1 


memory 


ok 


2 


2 


2 


1 


memory 


ok 


2 


2 


(2) 


0 


recall 


ok 




(2) 


2 


® 


recall 


ok 


1 


3 


® 


® 


recall fetip>ot>^iUi^ i: 


ok 


1 


3 


3 


1 


memory 


ok 


1 


3 


(2) 


0 


recall 


ok 


4 


4 


1 


1 


memory 


ok 


4 


4 


0 


0 


recall 


ok 


(3) 


® 


1 


0 


recall fi«)i3Etlt/ctJ 


ok 


4 


4 


1 


1 


memory 


ok 


® 


® 


1 


0 


recall U^ifi^tott 


ok 


5® 


3 


0) 


1 


recall *5tD-/^^->©A:^ 


ok 


5 


5 


5 


1 


memory 


ok 


6 


6 


6 


1 


memory 


ok 


2 


2 


7 


1 


memory 


ok 


® 


(2) 


2 


0 


recall 


ok 


2 


2 


® 


0 


recall 


ok 


7 


7 


0 


2 


memory 


ok 



[0 3 4 4] C(D^\ {ctol^X. fe (Color) . B (Sha 
pe) . (Speech) Rtf^W^ (instinct) tcoi/^TcO 

[0 3 4 5] COS2:6>60^e>*^^J:'5tc. ^^TJtcA:'^ 
[ 1 , 1 . 1 . 1 ] m^W. (memory) ^ntcik 
tc. 5#@iDil^T% fel. ff^3 0^'^^->*'«A:^^n 
^h. fe 1 0^tca-:j»v>T [1. 3. ®. 0] 

(recall) $n§3b\ :^^c0 6SgiOil^'e [1, 3. 

3. 1] (o^^^-ym^'&^nrzik(Di^^(Dm^-x^ 



ti. fel. fl5 3O/^^->C0A;'7tCj^LT [1, 3. 
®. 0] ?b'«)aS> (recall) ^nTt^^o 
[0 3 4 6] CCT% HE1i^fi^2 0 v-V^^l/^-r^i: 

iE^tctTt^n^;^)'^. :^j^cOS3tc^'rJ:^i&2 0 J:0^< 
50 <DXf}^^^ — y (^tt4 0 0/^^ — >') cDffi^tCjJLT 

1. 1. \^ m(o^o\cmm\cmm,\.rczyi^t^)Ut±m 

[0 3 4 7] 
[g2] 



ft 




B 






1 


1 


1 


1 


ok 


2 


2 


2 


2 


ok 


3 


3 


3 


3 


ok 


■ • ■ 


• ■ • 


■ • • 


• « • 


ok 


19 


19 


19 


19 


ok 


20 


20 


20 


20 


ok 



[0 3 4 8] 
[^31 
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§^ 




1 


1 


1 


1 


1 


2 


2 


1 


1 


3 


3 


1 


• « » 


• • • 


... 


• ■ • 


1 


20 


20 


1 


2 


1 


1 


1 


• • • 




« • • 


• • • 


2 


20 


20 


1 


* • • 


■ ■ • 


m m m 


• • • 


20 


20 


20 


1 



CO 3 4 9] m3(Dm^izmm am) r^^^i^i^^^jv 

[0 3 5 0] ^C5T\ STLi/^>'>4<;l'Tfe^jb^^/3^0 

[1, 1. 1. 1] t [2. 1. 1. 1] t^m^ 

tci21I-r^^^tiT^^:^i/^;b^ [1, 1. 1. l]^ 
[2. 2, 1, 1] ^til21toItET$>^o CcOil^. 

[0 3 5 1] 





P. 






1 


1 


1 




2 


2 


1 




3 


3 


1 




• • • 


• ■ • 


1 




20 


20 


1 





CD 3 5 2] tX±Ki0^b:rc:cfc-5^a»JB1Si^X'rA[C*3 

CO 3 5 3] s/c. mmmmhm^i.x. gBtt-r^^^^ 



(30) Itgfl 2 0 0 2 - 1 6 0 1 8 5 

Wn e w = f (Wo 1 d) 

Wo 1 d ti*v^jg^<3^^^^^o m^mm- 

ti\ ®TLl/^f5^^^Wn e w ti. fil/^fS'&^^^W 
o I d iS.m^'^mM^i o r g e t ^ffll/^T 

70 Wn e w = f (Wo 1 d ) = Wo I d - W 
forget 

[0 3 5 4] ^/t. ±i£2L/c^SSOmi(?:)mf*f^JT(i. 
CO 3 5 5] Sfc. i^TLV^A^3^^^->^0W»^ti. gg^ 

CO 3 5 6] ^^ic> A:^;^-v>'^'^;i/Si*'«ti*PUT-x';U 

CO 3 5 7] :^tc. ±tB03 8(0*tl1tfBa5 (ISM: 
Internal States Model) 2 0 5tcHalLT. n.l^'^y h 

^ tTlft ^ KjMt ii^ W T y a - ^ ^^jgffl b /c n 

CO 3 5 8] ^mm<oBm(o^wm\^^\^^x{t. u^.^y 

h^Ortgpmi (Internal States) ^XS^m^^^^^X ^ 
S-DCD^—iy (gauge) ^8 0(0*t^ (instinct) 

coy— >^i:LT. Nourishment (S:^) . Movement (A 
W . Moisture (7K^) . Urine Oi^W . Tiredness 

mm . Affection (M1t) . Curiosity mm RZf 
Sleepy (BS^) cne)(0^n^nt-J4 LT. Hu 

nger m^&O . Defecation mmWO > Thirst myic 
m X Urination mm&O . Exercise (Mift'fl):) . Aff 
ectlon {^m&O . Curiosity iit^m^LO RCFSIeepy 

mm&O (OSOCO*:^! (instinct) ^^Jt^-^^Xl^ 

50 CO 3 5 9] rtas^cffiti. &m£^'^^^VXl. (eiorhy 
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thm) xK^m^-^ri^mr^^^ifC^KfrntL. ^/c. 

♦itiO-l 0 0. ^fbOft-g-v^ti^ W!;^tfpersonallty_ 
gauge, cfg Rtfpersonal ity_perception. cfgtcfe^^lS 

[0 3 6 0] S/c:> Frustration (a»J3R^}S) ti. &(,^ 

n. RSjtCcfcoTy-v^ (gauge) ;bWf#jlO tc^ffcb 

[0 3 6 1] CclT% ^iHlcDi&^lFT^X htC*5l/^Tti. Ift /O 

^ntcmA nc^-rcfc^^ny-T^v^y^y (contents 
tree) ^ffiV^TO^^o COn v-r ^^^^V Tti. ± 
fi?b^e)lilltc. v^X-rA (system) . '&rf-^7.'rK (subs 
ystem) . F (mode) x (module) 

;l/ (Ethological Model) h UT^ffiPI^OfiK^b. ^ 20 

u/c^y u -^o^o^^Sowf^ot-x h 

^/c. ^-iHiiOiftf^xXhTti. 0 4 1 o^yu-tcj^ 
fSL/c^tl (instinct) . -T^^t^x Hunger (M:S 
a):) . Affection (gltS^i) . Curiosity (»^>lO . SI 
eepy (WSSX) %<^fflbT:feO. cne>cO*Hfe (instin 
ct) tc*tl6b;rc:y— (gauge) . f^^^-^x Nourishme 
nt (S5^) . Affection (g1fl) . Curiosity (K^S) . 
Sleepy (lEM) (O^^i^ffl bTV>;|,o ^*3. 
T-XhT'ti. ^i/^— ;l/ (module) ^Ilt7b/c:^ ttc^ 30 

bT:feO> ^/c. v'* (gauge) (instinct) 
^0^^6^co^/^Tti. ^J^^/S^ LTV^^jb^ cntcPM^ 

[0 3 6 2] *^SS^om^tc:fel'^T. iStS (emotion) 

MBlJe (Activation) ^ttS^ (Pleasantness) 

$^tc^^ Ittco^fSJg (Certainly) 
T. 3$fitCc):^3:^j^7t^P^tc^1S^SJSLT(/^^o MB! 
(Activation) ^(i. itC^!|*tC#ft-r^/W:t U X 40 

A cfc o r ?^^-r ^ s ^ T 1/ ^ ^ T 1/ ^ ^ > 

fe'Px (Pleasantness) *Hg?b'^^'n/c:tt?S/c 

CiSfi (Certainly) 31ffiffig LTi/^S tO^^if 

-KjS (Pleasantness) ^3<i6^tOtCiJ^S3&*^^ L 
T. ±^b/c 8 gauge, 8 instinct ifctcl^s Kjf^-rXh 
T(i±a?L/c4'>-'-i/\ 4*Sg^T) ^<^fflbTl>^o 
MfilS[ (Activation) . ttJg (Pleasantness) . fiifija 
(Certainly) ^co^/^T^i> 1 0 0—1 0 00® 50 
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m^o:>B^t^^(Ot\^. 'Kffl (Pleasantness) tWW 
m (Certainly) tcoo^Ttimtc 0 ^(S^-T^cfc "9 tcB# 
K^ifi*r§o ^fc. nmm. (Activation) (in 

stinct) mmcom^i^o^un-t^^^icL. /w^u 

(Biorhythm) tcMbTtifl^^iDS Si^ffl-T^^ 

[0 3 6 3] *tg (Instinct) cOrSSCDJg^lHi'Kje 
(Pleasantness) tCjSB*^-d:^o fiSifje (Certainly) 
ti. rim (Attention) LTi/^§ tfO:6^&^^'&. ^^i^ 
3 V:t:/v'x^ h (Vision Object) tc^^^OtOtO 
fifflJS^^O^^fgffi-r^o :^S1S (Activation) it. 
a^fi^tc/^-r^tUXA (Biorhythm) (OMtCcfc^;b^ S 
m (Sleep) tc^i(j;0^$>ofc^'&tcti^O*SS^fflv^T 

[0 3 6 4] ^lHlcOifti^f'Xhtc*5t:^^SfJPg«S^L 
T. >'^^:^UXA (Biorhythm) ti^SiS^ (Act I vat io 
n) (DMCK^-^-^. CCDm-^commm (Certainly) ^ 

0- 1 0 oc^DSBH-e^fb^^iri^^^b^ ctitcPi^^n 

[0 3 6 5] mi'^'r:^ hcom 1 <0:^<*^Ji:bT> 
mm (Sleep) (Eat) tcou^TcO-rX h*am^ 

g|4 2-0 4 4^#SSL^:6^6lft0^*r^o Ccom 1 cOifi 
ft-rXhTHi:. Hunger (IStfea^) ^Sleepy mm&O 
^(O^m (instinct) ^S^^L. 1114 KDzi^r-^^y 
yV—(D^i^^—)l^ (module) ic^^Uf (Search) / 
(eat) t. (Sleeping) O^D^t^ D^li 
1^4 2 ti. (Instinct) (Drt<?:)Hunger (S:& 
m ^XJS\eepy (ffilSS^) OBf P^^{k:;^^^L. El 4 3 
ti:> i^.ti (emotion) i:UTMSS (Activation) . 1^ 
m (Pleasantness) . miSA (Certainly) <Dm?^^^t 
^^L. 04 4(i> >/3> (Motivation) 

TCOWB (Sleep) t^^^ (Eat) cDBtP^^ib^^LT 

[0 3 6 6] cne)CD^4 2—0 4 4;6^^0^6:6^^cfco 
(c. PAT (^T^^) tcJ;^Sleep^>'U— ^cD^t)^x.;0'«pI 
mr^&O. ll^b^^l/^:6'^HIT (PPO iCcfc^Sleep^yU — 
5?,^e>^0^«9M^*>"IfiET'fe^o Hunger m^WO if^M^ 

n^Ct^c J: ^S leep^co^ 0 ^^mv^^o oP/b^ 
tirct^i^cnrnm (Activation) (c^ft*^^l/^0(i:> SI 
eep^^g/jN (MIN) . f 1 0 0T'$)^/ci6. 

(instinct) ;^3^^M^n:^l>/c46Tfe^o Hunger;?)^*;^ 

(MAX) . -r^t^** 1 0 Otc:&ofc?g> SJC^^JSS (Frust 
ration) m^^'^-f) (Drnf^mMr^fclsb. 'R* (Plea 
santness) (OmtUfi'^'PLm'PtfHc^^^o 

[0 3 6 7] :^j«:tc. l&i^7^XhOm2C0Mtt^J^LT. 
±iE4O±r(0y— >^ (gauge) . •r^t)^> Mourlshm 
ent (Si» . Affection (gIS) . Curiosity (« 
fjfe) . Sleepy (BSm) . CtiBtc^lS-r^ 4 

(Instinct) 0 4 1 <On >7^>^y U-^^ffli^ 
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fc^-a-O-^^^i/^ (behavior) (D^K>^t>K>h. 
(Instinct) ^%fBco^{t^H4 5 -1^4 7 tC^-To 1^ 
4 Sti. (instinct) O^F^^^tJ^^b. 04 6 
ti. .®tf (emotion) cOBlrP^^fb^^L. 1^4 7 (i. U 
U-Xp<;^7::iXyA (Release Mechanism) <onm^\t^ 

[0 3 6 8] cn^<D0 4 5—114 7 tC^l/^T. PAT 
(i^T'^l)) tcJ:^SIeep^tD^'9g^. Hunger 
m tCcfc^Eat^cO^D^x.. Curiosity (»^^lO 
^ItffiSti (Information Acquisition) 
^n^*nWatc®j{tbTl^^o S/c. (instinct) 
(DCurloslty m^^LO (100) tc ^ T V ^ 

<0(cKjft/)^^31bTi/^^l/-m^THi. (Pleasantne 

ss) t^'^^^yji^ (s^^^^) {cmnx^^^cDfo'^'^t'^o 

^e>tc, PAT (:^-Z?§) tcJcOSIeep^O^iiAn-r^t. ^Rfi 
(Pleasantness) ;?)^«;^l^tc^fbL. ^tltc^oT^B 
(ComfortSeeking) *^^fbbTV^^<i^;6'«i^ 

[0 3 6 9] tX±CDij!lft7^XhtCci:0. 114 1 cDri^x 
U -teg-:? < ift«f ib^M^T :/n-^tc J: 

[0 3 7 0] ^:lb\ ±a?b/'c^)5gcOfg»g«7)^ 
[0 3 7 1 ] 

^c^tCcfcO. A:^Jlt?Bi:-=e<0[g*cai?gLfcf7ifi^^^ 

cToctTIBIibT. llt/IBl-oA:^;1t$S3b^A;^^nfc:^ 

[0 3 7 2] sfc> *fi§0^tc^;g,njK^y hmmconmu 
[0 3 7 3] ccomntmm^nfcut^y hmmirt. a 
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[0 3 7 4] t/c. 2|s:^H^tc<3^§n4<*y hSStix A;'^ 
ft$B<^ai¥S/3^^1^a:lLfcA;^1t$Stc/CCTtTifiL/c$gm 

tcj:0. A;^1f$B^^OA:^1S$BtciSbTtT«lb/'c|g^ 
:^i1*$B*'« A:^ ^ tifc^Jc . S^f^ ^ ft®]^>Smit$atc 

[0 3 7 5] ^fc. *f|H^tC>f^^n.K'y hS^fOtTiftS'J 

[0 3 7 6] cco^mtmm'^nrcu:^^^ hmmi^t. x 
timmt't<Dxtimmcfts\:^rnmLrcim(o'im^^m 
mmt^^zf-oi^frmmi.r. nzfm-(oxiimmif^x 

[0 3 7 7] Sfc, :^^Bmcm?>ti^^-y h'&mii. Xt\ 

[0 3 7 8] *filB«lc^5a^-y h«B«OfTi()S<J 

?7ift^?l#ec L/-cA:/Dli?B<Oi^^«:^S|-r55^S^M 
[0 3 7 9] <l«5|B^A^)iiffl$nrcnd-ty h^B{±> A 

[0 3 8 0] sfc, ^^mim^ut>/ hmmii. mm 
50 nm'iis^i^^t^mwtimvam^^mtim^Lrcmmici 
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[0 3 8 1] ^fc^ *fgB^tc«^n.ic^y h^mco^mm 
[0 3 8 2] ccommmm^rifcut^y hmmi^t. ^ 

[0 3 8 3] ^Tc. ^mni^cm^a^^^y hSHii> Wli'f 

[0 3 8 4] s/c. *fe0^M^^i^;^ji^m^sti. 

[0 3 8 5] ^/c. ^^B^tCi^^n^'^^mT^'ffiti. mi"^ 
[0ffiOffi#^l«0^] 

[0 1] A^^ft^coftaft^^m-r^/ci^foifgifi^p^ 

[^2] mm^tf^^^-oi^xo:>mm'>'y:^^^M^rc^ 

imsi mrcfs:mm^^:!<s(D^mc'^^^x(Dmmffcmm 
Lfcmx^^o 

[04] fttT^SR (i:ffl^4. ^mm-t^fcisb^c 
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[0 5] iHg1tta^F^t^*$M^F^i:^0lia^^IttB^-r^ 

[0 6] iii»?#®SF^. ^nm^m. Rzfm3(o^Wi^ 
r^tcom^.^mm't^rcisbici^mi.rcmxh^o 
[0 7] *fg0^(D^j5giom^-e^^a.K^y hmmconm 

[08] ±aiC0a4-:^y hgSOlHlgS«^«:^-rya*vi57 
[0 9] ±aiOu.i<^y hSBOV:7 h'^/xTfii^^^-r 

[0 1 0] ±aiC0P4-N^y hmmcovy h^y :sLTmmc:i6 

[011] ±3it^^O□4-^y h^Bcoy hr^'xT^^tc^S 
XtSb^o 

[0 12] ±a>t07'yU^ — v'3 > • b-r-\'-0?7ift^:T^ 
[0 1 3] a4^'y h^B<?:>tTiS?*^<0/c46c?:>1tia^5S:^ 

[0 14] ^pgffl^;*-— h>cD^y— FtcfflB^n 

[0 1 5] ±}2Econ>i<'y hSBtc^ttS*fiWtc^§gp 
53'OtS^:?:^-r:/n >y ^0T^;g>o 

[0 16] D.t^y hgB^^ififlFO«i(^^ltt0^-r^/ca6 
teH5gfflLfc0Tfe^o 

[0 17] a.t^y h^goi!^^^*a^^■r§^SlJa5^^'r 

JO [0 1 8] mvf<D^^^'^^mm^^<tfr2^y^mx 

[0 1 9] i){^o^^tci5gffi'r^^^;i/xti^^-r0T$> 
oT. iL-^^^tc:l3tt^>'^;i/X*icol^'l40T*fe^o 
[02 0] S3{^cr)^^tc{^ffl-r^^^>'l/Xf|i§^^N-r0-efe 

*i^7r:-r?#140"rfe^o 

[02 1] «i{^^D^gtc<^ffl-r^/^7bxi|ii^^-r0r*s 
oT. iz:^^^7b^^W4^^S:t^5:^[pitcffb/'c^^tO/^;i/ 
x*i^^'r^ttt0'efe^o 
40 [0 2 2] mv^<o^^\c^m't^^^)\^7.mi^7r<tmx^ 

[02 3] lfif^<O^StcH^ffl-r§>'^;l/Xi|e;&^*r0T;* 

[02 4] i!j{tco^^tc<gffl"r^/^;^x«iii^/i^-r0T*^ 

>'^;bx*i^^-r4#1±0T'^^o 

[0 2 5] i!j{to^stcfiEffl'r^/^;i/xiii^^-r0-e$> 

50 oT. ffiO^^tC^oV^T. lSJ&fe±>^rS]icWLfc^#<o 
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[03 1] v-y-t^ FM?4^^t*^ttt0T'fe^o 

[03 2] ^mmmt^^2mmmt(Dm^.^^^niSL 

[0 3 3] n4<^y h^B«0^^^iag|5^afti:W«liS*^ 

[03 4] n4<^y hgBcoa^.^.egB1ta5;S^mTift*^ 
g|5^^-r:/Ci^y^0T'feSo 20 

[03 5] mwmrj:mm%mm-t^rcisb^cmmLrcmm 

[0 3 6] ut^^y h'^m(D'^>^9&msi^(Dmi^mmf&^ 

[03 7] jgtccto^g^^i^i^it^-r^^ipi^^^itt 
-r ^ /c i6 ffl L 0 ^ ^ o 
[03 8] mmmmi^>^r-ix<Dmwm(Dmmmf&^7n'r 

[0 3 9] ji.^jett^>XT-Atcfflv^e>n^ 2Soi5g@s^ 
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[04 0] fe;i,X;'3>'^^->'tCcfcOft;AcL/cA;^?^:i- 
^■r0Tfe^o 

[04 1] o4<^y h^SO^T^i!)^*^^i!I^'F^0■7"Xh^^T^ 
^y^y U-^^'r0T^)^o 

[04 2] ^ 1 (Oii!if^7=-X htc*5tt^*Bg (instinct) 
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(57)Abstract: 

PROBLEM TO BE SOLVED: To lean a behavior by linking it with input signals 
such as a sound signal. 

SOLUTION: This robot device 1 comprises a sound recognizing part 101 
adapted to detect information input at or before/after detecting a contact by a 
touch sensor that detects the contact, an association recall recording part 104 
adapted to link an occurring behavior corresponding to the contact with input 
information (the sound signal) detected by the sound recognizing part 101 for 
recording it, and a behavior generation part 105 adapted to control the device 
such that it makes a behavior associated by the association recall recording part 
104 on the basis of newly obtained input information (the sound signal). A 
sensor processing part 102 realizes the behavior corresponding to the contact 
detected by the touch sensor. 
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CLAIMS 
[Claim(s)] 

[Claim 1] A contact detection means to detect contact, and an input detection 
means to detect the information inputted the contact detection by the 
above-mentioned contact detection means, coincidence, or before and after time, 
A storage means to tie up and memorize the action which appeared according to 
the above-mentioned contact, and the input which the above-mentioned input 
detection means detected, Robot equipment characterized by having been 
reminded of action from the information in the above-mentioned storage means, 
and having the behavior control means which carries out the action based on the 
newly acquired input. 

[Claim 2] The action which appeared according to the contact detection by the 
above-mentioned contact means is robot equipment according to claim 1 
characterized by detecting contact from change of the control signal of the right 
hand side are as a result of [ of the right hand side by the external load of the 
above-mentioned contact ] displacement, and according [ the above-mentioned 
contact detection means ] to the above-mentioned external load. 
[Claim 3] It is robot equipment according to claim 1 have an action appearance 
means make action appear according to the contact detection by the 



above-mentioned contact detection means, and carry out that the 
above-mentioned storage means connects and memorizes the action made to 
appear according to the contact detection by the above-mentioned contact 
detection means, and the input the above-mentioned input detection means 
detected as the description. 

[Claim 4] The above-mentioned input detection means is robot equipment 
according to claim 1 characterized by detecting either [ at least ] image 
information or speech information. 

[Claim 5] The contact detection process of detecting contact, and the input 
detection process of detecting the information inputted the contact detection by 
the above-mentioned contact detection process, coincidence, or before and after 
time, The storage process which connects the action which appeared according 
to the above-mentioned contact, and the input detected at the above-mentioned 
input detection process, and is memorized for a storage means. The behavior 
control approach of the robot equipment characterized by being reminded of 
action from the information in a storage means, and having the behavior control 
process which carries out the action based on the newly acquired input. 
[Claim 6] The robot equipment which carries out [ having had a storage means 
tie up and memorize an input detection means detect information, the action 
result information which show the result acted according to the input which the 



above-mentioned input detection means detected, and the input concerned, and 
a behavior-control means specify the action result information in the 
above-mentioned storage means, and act based on the action result information 
concerned based on the newly inputted input, and ] as the description. 
[Claim 7] An emotion is changed according to an external factor and/or an inner 
factor, and it acts based on the condition of an emotion. The above-mentioned 
storage means As a result of acting according to the above-mentioned input, by 
making the condition of the produced emotion into the above-mentioned action 
result information, it connects to the input concerned and memorizes. The 
above-mentioned behavior control means Robot equipment according to claim 6 
characterized by recollecting the condition of an emotion of corresponding from 
the above-mentioned storage means, based on the above-mentioned input, and 
acting according to the condition of the emotion concerned. 
[Claim 8] The above-mentioned input detection means is robot equipment 
according to claim 6 characterized by detecting either [ at least ] image 
information or speech information. 

[Claim 9] The behavior-control approach of the robot equipment characterized 
by to have the storage process which connects the action result information 
which shows the result acted according to the input which an input detection 
means detected, and the input concerned, and memorizes for a record means, 



I 

ft • 

and the behavior-control process which specify the action result information in 
the above-mentioned storage means, and act based on the action result 
information concerned based on the newly inputted input. 

[Claim 10] An input detection means to detect information, and a characteristic 
quantity detection means to detect the characteristic quantity of the input which 
the above-mentioned input detection means detected, Based on the 
above-mentioned characteristic quantity, it is based on an information 
classification means to classify the above-mentioned input, and the classification 
of the above-mentioned input. Robot equipment characterized by having a 
reclassification means to change the classification of the above-mentioned input 
which caused the action concerned, based on the action result information which 
shows the result of having been controlled by the behavior control means and 
the above-mentioned behavior control means of acting, and having acted. 
[Claim 11] Robot equipment according to claim 10 with which the 
above-mentioned input is characterized by being image information or speech 
information. 

[Claim 12] The above-mentioned reclassification means is robot equipment 
according to claim 10 characterized by changing the classification of the 
above-mentioned input when the purport which was unpleasant is shown. 
[Claim 13] The characteristic quantity detection process of detecting the 



characteristic quantity of the input which the input detection means detected, 
The information classification procedure which classifies the above-mentioned 
input based on the characteristic quantity detected at the above-mentioned 
characteristic quantity detection process, It is based on the action result 
information which shows the result of having been controlled by the behavior 
control process and the above-mentioned behavior control process of acting, 
based on the classification of the above-mentioned input in the above-mentioned 
information classification procedure, and having acted. The behavior control 
approach of the robot equipment characterized by having the reclassification 
process which changes the classification of the above-mentioned input which 
caused the action concerned. 

[Claim 14] The robot equipment characterized by to have a behavior control 
means act, based on the information on the study object memorized for a study 
object specification means specify a study object, a storage means memorize 
the information on the study object which the above-mentioned study object 
specification means specified, and the detected new object and the 
above-mentioned storage means. 

[Claim 15] The above-mentioned study object specification means is robot 
equipment according to claim 14 which carries out the segment of the input 
image information, and is characterized by detecting the temporal response of a 



field which carried out the segment, and specifying the object corresponding to 
the field to which the temporal response became the specified quantity as a 
study object. 

[Claim 16] The above-mentioned study object specification means is robot 
equipment according to claim 14 characterized by specifying a study object 
based on input speech information. 

[Claim 17] The above-mentioned study object specification means is robot 
equipment according to claim 16 characterized by the thing of input speech 
information for which a study object is specified at least from the information on 
one of the information on sound volume or a direction. 

[Claim 18] The above-mentioned study object specification means is robot 
equipment according to claim 14 characterized by detecting the look of the 
informer who teaches the object for study, and specifying a study object from the 
look concerned. 

[Claim 19] The behavior-control approach of the robot equipment which carries 
out [ having had the behavior-control process which acts based on the study 
object specification process of specifying a study object, the storage process 
which memorize the information on the study object specified at the 
above-mentioned study object specification process for a storage means, and 
the information on the study object which memorized for the detected new object 



and the above-mentioned storage means, and ] as the description. 
[Claim 20] Robot equipment characterized by to have a study means make a 
detection means detect the condition of the above-mentioned joint section that 
external force is acting through the joint section and the above-mentioned 
right-hand-side material for operating right-hand-side material and the 
above-mentioned right-hand-side material, and the condition and the 
above-mentioned external force of the above-mentioned joint section which the 
above-mentioned detection means detected correspond, and learn it. 
[Claim 21] It is robot equipment according to claim 20 characterized by for the 
above-mentioned detection means detecting the external force which acts on the 
joint section concerned through the above-mentioned right-hand-side material 
as a condition of the above-mentioned joint section, and for the 
above-mentioned study means making the external force which the 
above-mentioned detection means detected, and the external force to the 
above-mentioned right-hand-side material correspond, and learning. 
[Claim 22] It is robot equipment according to claim 20 characterized by for the 
above-mentioned detection means detecting the difference of the desired value 
of the condition of the joint section, and an actual measurement as a condition of 
the above-mentioned joint section, and for the above-mentioned study means 
making the difference and the above-mentioned external force of the 



above-mentioned desired value and tlie actual measurement which the 
above-mentioned detection means detected correspond, and learning. 
[Claim 23] It is robot equipment according to claim 22 characterized by for the 
above-mentioned detection means to detect change of the control signal of the 
above-mentioned joint section by the above-mentioned external force as a 
difference of the desired value of the condition of the above-mentioned joint 
section, and an actual measurement, and for the above-mentioned study means 
to make the control signal and the above-mentioned external force which the 
above-mentioned detection means detected, and which changed correspond, 
and to learn. 

[Claim 24] Robot equipment according to claim 20 characterized by having 
further the control means of operation to which predetermined actuation is 
carried out based on the study result of the above-mentioned study means, and 
the condition of the account joint section after study. 

[Claim 25] The above-mentioned study means is robot equipment according to 
claim 20 characterized by learning by the input layer and the neural network who 
hides and has a layer and an output layer. 

[Claim 26] External force detection equipment characterized by having a 
detection means to detect the condition of the joint section for operating 
right-hand-side material, and an external force detection means to detect the 



external force which acts on the above-mentioned right-hand-side material 
based on the condition of the joint section which the above-mentioned detection 
means detected. 

[Claim 27] It is external force detection equipment according to claim 26 which 
the above-mentioned detection means detects the difference of the desired 
value of the condition of the joint section, and an actual measurement as a 
condition of the above-mentioned joint section, and is characterized by the 
above-mentioned external force detection means detecting the 
above-mentioned external force based on the difference of the above-mentioned 
desired value and the actual measurement which the above-mentioned 
detection means detected. 

[Claim 28] It is external-force detection equipment according to claim 27 which 
the above-mentioned detection means detects change of the control signal of 
the above-mentioned joint section by the external force through the 
above-mentioned right-hand-side material as a difference of the desired value of 
the condition of the above-mentioned joint section, and an actual measurement, 
and is characterized by for the above-mentioned external force detection means 
to detect the above-mentioned external force based on the control signal which 
the above-mentioned detection means detected, and which changed. 
[Claim 29] The external force detection approach which detects the condition of 



the joint section for operating right-hand-side material, and is characterized by 
detecting the external force which acts on the above-mentioned right-hand-side 
material based on the condition of the detected above-mentioned joint section. 



DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the external force detection 
equipment and the external force detection approach of detecting external force 
in the behavior control approach list of the robot equipment which controls action 
of robot equipment and robot equipment. 
[0002] 

[Description of the Prior Art] Conventionally, in the field called a knowledge 
acquisition or language acquisition, it was mainly a thing based on the 
associative storage of vision information and acoustic-sense information. 
[0003] In "LEARNING WORDS FROM NATURAL AUDIO-VISUAL INPUT" (Deb 
Roy, Alex Pentland) (henceforth reference 1), research which learns language 
from input voice and an input image is done. The outline of the learning 



technique in this reference 1 is as follows. 

[0004] Coincidence or time amount is got mixed up, and a picture signal and a 
sound signal (acoustic signal) are made to input into a learning system. By 
reference 1. the event (Event) of the pair of the image inputted almost 
simultaneously in coincidence or time amount in this way and voice is called AV 
event (AV-Event). 

[0005] Thus, about the picture signal and sound signal which were inputted, an 
image processing detects a color and a form from a picture signal, and voice 
section detection (RIKARENTO neural network) and phoneme analysis are 
performed from a sound signal by speech processing by one side. While 
specifically classifying the image inputted from the descriptions (distance etc.) in 
an image feature space into each class (the class for recognizing a specific 
image, recognition class.), the sound inputted from the descriptions (distance 
etc.) in a sound feature space is classified into each class (the class for 
recognizing a specific sound, recognition class.). The feature space is 
constituted as two-dimensional [ which used the color-difference signal and the 
luminance signal as the element ], or multi-dimension space beyond it, if it is the 
space constituted with two or more elements, for example, is a picture signal, as 
shown in drawing 1 . And since the inputted image shows predetermined 
distribution in such a feature space, recognition of a color is attained based on 



such distribution. For example, in such a feature space, a class classification is 
carried out from distance relation, and a color is recognized. 
[0006] recognition of a sound — the continuation recognition HMM (Hidden 
Markov Model) - law is adopted. The continuation recognition HMM method 
(only henceforth HMM) makes recognition possible by making a sound signal 
into a phoneme sequence. Moreover, an above-mentioned RIKARENTO neural 
network is the neural network of flow from which a signal returns to an input layer 
side. 

[0007] And it is learning by tying up the phoneme based on the correlation 
(correlation study) about a concurrence by which the class classification was 
carried out to the class classification stimulus (image) by the image processing 
(relating). That is, although shown by the image, an identifier and description are 
gained as a study result. 

[0008] For example, according to the above study, it is specified [ voice / input ] 

by the class classified into "a-ka", "a-o", "ki" etc. which an input image is 

specified by the image class classified into "the red thing" which consists of 
image information, "a blue thing", etc. (recognition), and consist of sound 
information as shown in drawing 2 (recognition). 

[0009] And such an image and voice by which the class classification was 
carried out relate by correlation study, and are carried out. Thereby, when the 



image input of "the red thing" is carried out, a learning systenn 200 can output the 

phonenne sequence of "a-ka" as a result of the correlation study. 

[0010] 

[Problem(s) to be Solved by the Invention] By the way, the robot equipment 
which acts autonomously according to a surrounding environment (external 
factor) and a surrounding internal state (conditions, such as an inner factor, for 
example, feeling, and instinct) is proposed in recent years. Such robot 
equipment is constituted as what considers interaction (dialogue) as human 
being or an environment. For example, the so-called pet robot which carries out 
the configuration imitated to the animal and behavior like an animal as robot 
equipment is proposed. 

[0011] For example, in such robot equipment, making various information learn 
leads to improvement in the enjoyableness. If action can be made to learn 
especially, it can be said that enjoyableness increases. 

[0012] However, when applying the learning technique (reference 1) mentioned 
above to the robot equipment constituted for the purpose of causing action, the 
following problems arise. 

[0013] First, in learning technique which was mentioned above, it does not set 
up causing action appropriately. 

[0014] By the above-mentioned reference 1, if the memorized word to an input 



signal is generated or it is judged as a new signal, utterance will generate the 
sequence of a suitable phoneme and will be outputted. However, robot 
equipment is not necessarily asked for the output (utterance) which expresses 
an input signal as it is as interaction (dialogue) with human being or an 
environment, and it is required for it that suitable action should be caused to an 
input. 

[0015] Moreover, when carrying out a class classification based on the distance 
relation between an image feature space and a sound feature space, about the 
image and voice which were acquired, it becomes near information in an image 
feature space and a sound feature space, but it is assumed, when the actions to 
it differ, or also when the actions to it want to differ. In such a case, it must be 
reflected in a class classification so that the optimal action may be made. 
However, the conventional technique cannot cope with such a situation. 
[0016] Moreover, the conventional knowledge acquisition or language 
acquisition mainly consists of following matters. 

(1) A means to generate the class classification of . picture signal, and a new 
class. 

(2) A means to generate the class classification of . acoustic signal, and a new 
class. 

(3) Means which ties up the result of . item (1) and an item (2). Or the means 



which carries out [ sound / an image and ] correlation study. 

[0017] Of course, there are some to which functions other than this are added. 

However, these three are a component at least. 

[0018] As the technique of a class classification of this item (1) and an item (2), 
various technique, such as mapping to a feature space, the parametric 
identifying method using the foresight-knowledge over a meaningful signal, and 
a probable class classification result, exists. 

[0019] About an image, it can carry out by controlling the threshold in color 
templates, such as red, blue, green, and yellow, in a color space, for example, or 
the general image recognition technique, such as searching for the probability as 
each color from the distance in the storage region of a certain color and the 
feature space of an input color, can already be used to the color stimulus shown. 
For example, search for the probability which is such a class from the distance of 
the field which the characteristic quantity of the inputted image shows from the 
field by which the class classification has already been carried out as 
characteristic quantity set to the feature space as shown in drawing 1 . Moreover, 
technique, such as a neural network, is also effective. 

[0020] On the other hand about voice, the phoneme sequence remembered to 
be phoneme detection and the inputted phoneme sequence by HMM is 
compared, and the probable word recognition based on it etc. is used. 



[0021] Moreover, there is the following as a means to generate the new class of 
the above-mentioned item (1) and an item (2). 

[0022] It evaluates whether it belongs to the existing class to an input signal, and 
if it judges that it belongs to the existing class, the input signal will be made to 
belong to the class, and will be made to reflect in the evaluation approach 
belonging to a class. If it Is judged that it belongs to no existing class, a new 
class will be generated, and it will learn so that evaluation belonging to [ the ] a 
class may be performed based on the input stimulus. 

[0023] For example, when it is judged that it does not belong to the existing class 
(the class of Image A, the class of Image B, ...) about an image class as 
generation of a new class, as shown in (A) among drawing 3 A certain class (for 
example, class of Image A) is divided now, and the class of a new image is 
generated. About a sound class When it is judged that it does not belong to the 
existing class (the class of a sound alpha, the class of a sound beta, ...), as 
shown in (B) among drawing 3 . a certain class (class of a sound beta) is divided 
now. and the class of a new sound is generated. 

[0024] Moreover, there is associative storage etc. in the technique of connecting 
the image of the above-mentioned item (3), and the class of a sound. 
[0025] Let the discernment classes of an image be Vector (henceforth an image 
discernment vector) [i] (i= 0. 1 NIC- 1) IC, and the vector (henceforth a sound 



discrimination vector) [j] (j= 0, 1 NSC- 1) SC of tlie discernment class of a 

sound. The probability or evaluation result value of each recognition class is set 
as each vector value to the image and sound signal which were shown (it inputs 
for study). 

[0026] In the associative storage of a self-remembrance mold, it considers as 
one vector which can show the image discernment vector IC and the sound 
discrimination vector SC by (1) type and (2) formulas. 
[0027] 
[Equation 1] 

CV[n]=IC[n] (0^n<NIC) • • • (l) 

[0028] 
[Equation 2] 

CV[n]=SC[n-NIC] (O^iKNSC) • • ' (2) 

[0029] In addition, as associative storage of a self-remembrance mold, the 
so-called hop field network which the hop field advocates is famous. 
[0030] Each vector is made by one vector as follows. Now, if Vector valve flow 
coefficient is made into a column vector, the associative storage of a 
self-remembrance mold will be made by adding the matrix of delta_W of (3) 
types to the matrix W which has memorized the present condition. 



[0031] 
[Equation 3] 

delta_W=CVxtrans(CV) • ' * (3) 

[0032] Thereby, it considers that an image stimulus (inputted image) is a certain 
class, and it becomes possible to connect to the word (for this to be the class of 
HMM) of a speech recognition result at the class. Although each class shows 
suitable magnitude to the red of an image stimulus with whenever [ on a feature 
space / stimulus ], or, distance and each class reacts to the phoneme sequence 
of voice "a-ka" in suitable magnitude similarly by showing a new image (for 
example, red) and inputting voice "a-ka" High correlation will be shown in order 
that the class of the same image and voice may show a high value to the same 
stimulus by treating them as a matrix of correlation and equalizing them 
statistically by the above-mentioned formula. Thereby, if red is shown as an 
image, associative storage of the class of HMM "a-ka" will be carried out. 
[0033] On the other hand, at "Perceptually grounded meaning creation" (Luc 
Steels, ICMAS, and Kyoto 1996) (henceforth reference 2), semantic acquisition 
is performed in the experiment called a discrimination game (Discrimination 
Game). A discrimination game is as follows as an outline. 

[0034] As mentioned above, without an image and sound restricting, a system 



carries out two or more general sensor channels and ****** detectors, and is 
constituted. And if there is no characteristic quantity which is going to try in order 
that the object (software constitutes) called an agent (agent) may distinguish 
other objects (object already recognized) to the shown object (object) with those 
****** detectors, for example, is going to attain distinctlon-ization based on 
characteristic quantity, and can be distinguished, the new ****** detector 
corresponding to the newly shown object will be made. And it loses, when it does 
not have the characteristic quantity detector without distinguishable 
characteristic quantity which case [ a detector ] namely, corresponds, and if had, 
evaluation called a victory is carried out. 

[0035] And the whole system operates by the principle of SEREKUSHONISUTO. 
That is, if it gathers and loses in the probability which will be survived if a game is 
won, a new characteristic quantity detector will be made. However, the new 
characteristic quantity detector is used in a next game, and it does not know 
whether take out a right result. The agent who improves distinction more comes 
to survive by such actuation. 

[0036] The above is the outline of a discrimination game, and such a 
discrimination game can also be regarded as the technique of making a better 
****** detector by selection selection, if it puts in another way. 
[0037] Moreover, at 'The Spontaneous Self-organization of an Adaptive 



Language" (Luc Steels, Muggleton, S.(ed.) (1996) Machine, Intelligence 15.) 
(henceforth reference 3), generating of language is discussed by the technique 
of a language game (Language Game). A language game consists of the 
following three steps. 

[0038] The 1st step, propagation (propagation). The 2nd step, chestnut ESHON 
(creation). An agent (agent) makes a new word from this step, and it is 
associative attachment ** about the new description to it. The 3rd step, a self 
organization (self-organization). At this step, the system carries out 
self-organizing to selection by selection. 

[0039] This language game consists of the 3rd step associated with the part of 
the 1st step which is in charge of the so-called image processing, the part 
(however, part which does not carry out speech recognition in fact, but inputs the 
so-called alphabetic character) of the 2nd step corresponding to the word related 
to language processing, and the image acquired from it and its word in step 1. 
There is no part in which the discrimination game mentioned above is equivalent 
to the 2nd step, and it is aimed only at distinction in the existing feature space. 
[0040] Moreover, in "language acquisition by the voice input based on the 
conceptual structure from perceptual information" (Iwasaki, Tamura, Sony 
Computer Science Laboratory Inc.) (henceforth reference 4), HMM is used for 
speech recognition and the image is performing syntax acquisition using the 



typical pattern (thing of colors, such as configurations, such as a round head and 
a trigonum, and red. and blue) which the color on the monitor of a computer 
attached. 

[0041] By reference 4. as shown in drawing 4 , a user clicks the pattern on a 
monitor 210 (a certain body) with a mouse (directing with a pointer 212), and 
speaks with "a red round head" etc. with voice to coincidence. And the 1st step 
in the language game of the reference 3 mentioned above - the 3rd step are 
performed probable using the discriminator theory of game of a color image, and 
the speech recognition of HMM. 

[0042] The verification (verification) by predetermined technique is performing 
generation of a new class. By this reference 4, when it judges that HMM is used 
for speech recognition and a new class is built with verification, a new class is 
generated by dividing that HMM further. 

[0043] furthermore, a motion of the pattern which was in such a monitor 210 can 
be made to recognize by moving the pattern 211 chosen with the mouse by 
inputting into up to the 2nd object (Obj2) 213 actuation, simultaneously the voice 
of "carrying upwards" migration" so that it may be shown as a direction of an 
arrow head in drawing 4 [ object / 1st object 211 / "/ (Objl) ] And about such 
recognized actuation, the class division is carried out by HMM. 
[0044] As mentioned above, the technique about a knowledge acquisition or 



language acquisition is proposed variously. However, the following problems 
exist from the field of the action acquisition (action study) in robot equipment 
also about such technique. 

(1) The distance in the feature space of . input signal, and problem about class 
afTiliation evaluation. 

(2) Problem about . action generation and its evaluation. 

(3) Problem about what both who perform interaction share . study object for. 
The problem of a study object shared [ so-called ]. 

[0045] In an above-mentioned problem (1), there is a difficult situation only by 
being influenced by the storage information from which it was recollected by the 
sound signal with which only the information in connection with a picture signal 
in class affiliation evaluation was inputted into coincidence, or its two to the 
picture signal inputted, for example. In addition, class affiliation evaluation 
serves as an index of to which class to correspond here. 

[0046] For example, it is assumed that the picture signal made very near in the 
feature space of the existing class was inputted. For example, as shown in (A) 
among drawing 5 , it is the case where Class A and Class B are close in an 
image feature space. However, the picture signal inputted here shall be made 
into the signal which should generate a class new in fact. 

[0047] On the other hand, under such conditions, as other information on the 



object corresponding to this picture signal, a sound signal is inputted into 
coincidence, and if decision that this inputted sound signal is very separated with 
the existing class is made, the new class about a sound will be generated about 
the object concerned. For example, as shown in (B) among drawing 5 , in a 
sound feature space, distribution shall differ and Class alpha (sound class 
matched with the class A of an image) and Class beta (sound class matched 
with the class B of an image) shall set up a threshold S2. 

[0048] Therefore, if the class affiliation evaluation carried out to class affiliation 
evaluation of an image based on the feature space about a sound can be made 
to reflect, a class new also about an image is generable. For example, by 
making the class affiliation evaluation in a sound feature space reflect, as shown 
in (A) among drawing 5 , the threshold S1 which distinguishes both can be set 
up between the class A of approximation of the description, and Class B. That is, 
affiliation evaluation of a class comes to be appropriately made by referring to 
class affiliation evaluation of another side. 

[0049] However, when a class is very near also about both a picture signal and a 
sound signal, it is difficult only now to generate an image and a class new about 
voice. Even if this is a time of having the completely different description seen 
from the 3rd feature space when the class approximates in the feature space of 
an image and a sound as shown in (A) and (B) for example, among drawing 6 . I 



hear that distinction-ization cannot do them and there is. For example, what 
shows the description of action can be considered as the 3rd feature space. 
[0050] Then, this invention is made in view of the above-mentioned actual 
condition, and aims at offer of the behavior control approach of the robot 
equipment which can distinguish an object appropriately in each feature space, 
and robot equipment. 

[0051] Moreover, it is how do generate new action of robot equipment and to 
evaluate It about an above-mentioned problem (2), when the signal which should 
be judged to be new class affiliation, for example is inputted. 
[0052] Although evaluation of language generating is considered to correspond 
to evaluation of the generated action by the conventional technique, the 
phoneme train of arbitration is generated by reference 3. Input signal ****** 
becomes the identifier of the object by which It is contained In the picture signal 
etc. However, the motion train of arbitration cannot be generated as generation 
of action. 

[0053] For example, even if each four feet generate the arbitration train of each 
joint angle of the robot equipment of three degrees of freedom, in almost all 
cases, they do not become likely to be meaningful. Moreover, although the 
phoneme sequence only becomes the identifier of the object (object) In 
language generating, It becomes a problem In action generation whether what 



we do with evaluation of the right and wrong about the action which made such 
and was generated. 

[0054] Moreover, this invention is made in view of such the actual condition, and 
aims at offer of the behavior control approach of the robot equipment which can 
generate suitable action, and robot equipment to the input. 
[00551 Moreover, about an above-mentioned problem (3), it is the problem of a 
study object shared [ so-called ] Qoint cautions), and originates in the information 
which robot equipment is perceiving being various. For example, human being 
has the ball of Orange in the completely different direction from the picture signal 
input section (for example, CCD camera) of robot equipment, and if the object 
(object) included in the visual field of robot equipment is a pink box even if it 
speaks and educates "the ball of Orange", "the ball of Orange" will be tied up for 
it. 

[0056] Moreover, in the technique of the reference 4 mentioned above, although 
the pattern 211 on a monitor 210 was clicked with the mouse and specified as a 
study object (educational object), there is no assignment means of such a study 
object in the real world. Moreover, even when it is assumed that the theory of the 
above-mentioned reference 2 and reference 3 was applied to robot equipment, 
to the object which said among some objects included in vision, and the hand 
chose suitably, the action which robot equipment makes utters the identifier 



according to storage of it. and says it based on tlie utterance, and it is said tliat a 
hand chooses a study object. Now, it is not the study which specified a study 
object which is nnade in the real world. 

[00571 Moreover, this invention is made in view of such the actual condition, 
enables sharing (joint cautions) of a study object, and aims at offer of the 
behavior control approach of the robot equipment which can specify a study 
object appropriately, and robot equipment. 

[0058] Moreover, although conventional robot equipment 1 detected that the 
force was applied to the head etc. from the exterior through the touch sensor 
formed in the head and was carrying out interaction (dialogue) with a user, 
interaction will be restricted by the number and its an'angement location of a 
sensor in this. 

[0059] Then, this invention is made in view of such the actual condition, and 
aims at offer of the robot equipment which makes it possible to make high the 
degree of freedom of the interaction by the contact (external force) from a user, 
external force detection equipment, and the external force detection approach. 
[0060] 

[Means for Solving the Problem] A contact detection means to detect contact in 
order that the robot equipment concerning this Invention may solve an 
above-mentioned technical problem, An Input detection means to detect the 



information inputted the contact detection by tlie contact detection means, 
coincidence, or before and after time. It lias a storage means to tie up and 
memorize the action which appeared according to contact, and the input which 
the input detection means detected, and the behavior control means which is 
reminded of action from the information in a storage means, and carries out the 
action based on the newly acquired input. 

[0061] An input detection means detects the information inputted before and 
after [ of the contact detection by the contact detection means ] time, and the 
action which appeared according to contact, and the input which an input 
detection means detected connect, it memorizes to a storage means, action 
associates from the information in a storage means based on the input newly 
acquired by the behavior-control means, and robot equipment equipped with 
such a configuration canries out the action. 

[0062] Thereby, robot equipment makes corresponding action appear again, 
when input and the action which appeared on that occasion are tied up and 
memorized and the same input is inputted again. 

[0063] Moreover, the behavior control approach of the robot equipment 
concerning this invention The contact detection process of detecting contact in 
order to solve an above-mentioned technical problem, and the input detection 
process of detecting the information inputted the contact detection by the contact 



detection process, coincidence, or before and after time, it has the storage 
process which connects the action which appeared according to contact, and the 
input detected at the input detection process, and is mennorized for a storage 
means, and the behavior control process which is reminded of action from the 
information in a storage means, and carries out the action based on the newly 
acquired input. 

[0064] Corresponding action is made to appear again, when robot equipment 
tied up and memorizes input and the action which appeared on that occasion by 
such behavior control approach of robot equipment and the same input is 
inputted again. 

[00651 Moreover, in order that the robot equipment concerning this invention 
may solve an above-mentioned technical problem An input detection means to 
detect information, and the action result information which shows the result of 
having acted according to the input which the input detection means detected. It 
has a storage means to tie up and memorize the input concerned, and a 
behavior control means to specify the action result information in a storage 
means, and to act based on the action result information concerned based on 
the newly inputted input. 

[0066] Robot equipment equipped with such a configuration connects the action 
result information which shows the result of having acted according to the input 



which the input detection means detected, and the input concerned, mennorizes 
them for a storage means, specifies the action result information in a storage 
means based on the input newly inputted by the behavior-control means, and 
acts based on the action result information concerned. 

[0067] Thereby, when input and the action result information on a result that it 
acted according to the input are tied up and memorized and the same input is 
inputted again, robot equipment recollects the past action based on the action 
result information which counters, and makes suitable action appear. 
[0068] Moreover, the behavior-control approach of the robot equipment 
concerning this invention has the storage process which connects the action 
result information which shows the result acted according to the input which an 
input detection means detected in order to solve an above-mentioned technical 
problem, and the input concerned, and memorizes for a record means, and the 
behavior-control process which specify the action result information in the 
above-mentioned storage means, and act based on the action result information 
concerned based on the newly inputted input. 

[0069] When robot equipment connects input and the action result information 
on a result that it acted according to the input, by such behavior control approach 
of robot equipment, it memorizes and the same input is inputted again, the past 
action is recollected based on the action result information which counters, and 



suitable action is made to appear. 

[0070] Moreover, the robot equipment concerning this invention has a 
reclassification means change the classification of the input which caused the 
action concerned based on the action result information which shows the result 
acted with an input detection means detect information, a characteristic-quantity 
detection means detect the characteristic quantity of the input which an input 
detection means detected, an information classification means classify input 
based on characteristic quantity, a behavior-control means act based on the 
classification of input, and a behavior-control means. The classification of the 
input which caused the action concerned changes with a reclassification means 
based on the action result information which shows the result robot equipment 
equipped with such a configuration detected the characteristic quantity of the 
input which the input detection means detected with a characteristic-quantity 
detection means, classified input according to an information classification 
means based on characteristic quantity, acted based on the classification of 
input with a behavior-control means, was controlled by the behavior-control 
means, and acted. 

[0071] Thereby, robot equipment acts according to the classification of input, 

and changes the classification based on the result of having acted. 

[0072] Moreover, the behavior control approach of the robot equipment 



concerning this invention The characteristic quantity detection process of 
detecting the characteristic quantity of the input which the input detection means 
detected in order to solve an above-mentioned technical problem, The 
information classification procedure which classifies input based on the 
characteristic quantity detected at the characteristic quantity detection process, 
Based on the action result information which shows the result of having been 
controlled by the behavior control process which acts based on the classification 
of the input in an information classification procedure, and the behavior control 
process, and having acted, it has the reclassification process which changes the 
classification of the input which caused the action concerned. 
[0073] By such behavior control approach of robot equipment, robot equipment 
acts according to the classification of input, and changes the classification based 
on the result of having acted, <BR> [0074] Moreover, in order to solve an 
above-mentioned technical problem, based on the information on the study 
object memorized for a study object specification means specify a study object, 
a storage means memorize the information on the study object which the study 
object specification means specified, and the detected new object and a storage 
means, it has robot equipment concerning this invention with a behavior-control 
means act. 

[0075] Robot equipment equipped with such a configuration memorizes the 



information on the study object which a study object specification means to 
specify a study object specified for a storage means, and acts with a behavior 
control means based on the information on the study object memorized for the 
detected new object and the storage means. 

[0076] Thereby, robot equipment carries out predetermined action, when a study 
object is memorized and the same object is inputted again. 
[0077] Moreover, the behavior-control approach of the robot equipment 
concerning this invention has the behavior-control process which acts based on 
the study object specification process of specifying a study object, the storage 
process which memorize the information on the study object specified at the 
study object specification process for a storage means, and the information on 
the study object which memorized for the detected new object and the storage 
means, in order to solve an above-mentioned technical problem. 
[0078] By such behavior control approach of robot equipment, robot equipment 
carries out predetermined action, when a study object is memorized and the 
same object is inputted again. 

[0079] Moreover, the robot equipment concerning this invention is equipped with 
a study means to make a detection means to detect the condition of the joint 
section that external force is acting through the joint section and the 
right-hand-side material for operating right-hand-side material and 



right-hand-side material, and the condition and external force of the joint section 
which the detection means detected correspond, and to learn them in order to 
solve an above-mentioned technical problem, 

[0080] Robot equipment equipped with such a configuration makes the condition 
and external force of the joint section which detected the condition of the joint 
section that external force was acting through right-hand-side material, with the 
detection means, and the detection means detected correspond, and is learned 
with a study means. That is, robot equipment is made to correspond to the 
condition of the joint section which changes according to the external force 
which acts on right-hand-side material, and learns the external force concerned. 
[0081] Moreover, the external force detection equipment concerning this 
invention is equipped with a detection means to detect the condition of the joint 
section for operating right-hand-side material, and an external force detection 
means to detect the external force which acts on right-hand-side material based 
on the condition of the joint section which the detection means detected in order 
to solve an above-mentioned technical problem. 

[0082] External force detection equipment equipped with such a configuration 
detects the external force which acts on right-hand-side material based on the 
condition of the joint section which detected the condition of the joint section for 
operating right-hand-side material with the detection means, and the detection 



means detected. That is, external force detection equipnnent detects the external 
force which acts on right-hand-side material based on the condition of the joint 
section which operates the right-hand-side material concerned. 
[0083] Moreover, in order to solve an above-mentioned technical problem, the 
external force detection approach concerning this invention detects the condition 
of the joint section for operating right-hand-side material, and detects the 
external force which acts on right-hand-side material based on the condition of 
the detected joint section. That is, the external force detection approach detects 
the external force which acts on right-hand-side material based on the condition 
of the joint section which operates the right-hand-side material concerned. 
[0084] 

[Embodiment of the Invention] Hereafter, the gestalt of operation of this invention 
is explained in detail using a drawing. The gestalt of this operation is robot 
equipment of the autonomous mold which acts autonomously according to a 
surrounding environment (external factor) or an internal condition (inner factor), 
[0085] First, the gestalt of operation explains the configuration of robot 
equipment and explains the application part of this invention in robot equipment 
to a detail after that. 
[0086] 

(1) As shown in the block diagram 7 of the robot equipment by the gestalt of this 



operation, while considering as the so-called pet robot of the configuration which 
imitated the "dog" and connecting the leg units 3A, 3B, and 3C and 3D with front 
and rear, right and left of the idiosoma unit 2, respectively, the head unit 4 and 
the tail section unit 5 are connected and constituted by the front end section and 
the back end section of the idiosoma unit 2, respectively. 

[0087] As shown in drawing 8 , the control section 1 6 formed by connecting CPU 
(Central Processing Unit)10, DRAM (Dynamic Random Access Memory)11, a 
flash ROM (Read Only Memory) 12, PC (Personal Computer) card interface 
circuitry 13, and a digital disposal circuit 14 mutually through an internal bus 15 
and the dc-battery 17 as a source of power of this robot equipment 1 are 
contained by the idiosoma unit 2. Moreover, the angular-velocity sensor 18, an 
acceleration sensor 19, etc. for detecting the sense of robot equipment 1 and the 
acceleration of a motion are contained by the idiosoma unit 2. 
[0088] Moreover, the CCD (Charge Coupled Device) camera 20 for picturizing 
an external situation to the head unit 4, The touch sensor 21 for detecting the 
pressure received by "it strokes" and the physical influence of "striking" from a 
user, The distance robot 22 for measuring the distance to the body located 
ahead, LED (Light Emitting Diode) (not shown) equivalent to the microphone 23 
for collecting alien frequencies, the loudspeaker 24 for outputting voice, such as 
a cry, and the "eye" of robot equipment 1 etc. is arranged in the predetermined 



location, respectively. 

[0089] Furthermore, Actuators 251 -25n and Potentiometers 261 -26n for free 
frequency are arranged in the joining segment of the joint part of each leg unit 
3A-3D, each joining segment of each leg unit 3A-3D and the idiosoma unit 2. the 
head unit 4, and the idiosoma unit 2, and the list by the joining segment of tail 5A 
of the tail section unit 5, respectively. For example, Actuators 251 -25n have the 
servo motor as a configuration. Leg unit 3A - 3D are controlled by the drive of a 
servo motor, and it changes in a target posture or actuation. 
[0090] And LED and 251 -25n of each actuator are connected with the digital 
disposal circuit 14 of the control section 16 through the hubs 271 -27n 
corresponding to various sensor lists, such as these angular-velocity sensor 18, 
an acceleration sensor 19. a touch sensor 21, a distance robot 22, a microphone 
23, a loudspeaker 24, and each potentiometers 261 -26n, respectively, and direct 
continuation of CCD camera 20 and the dc-battery 17 is carried out to the digital 
disposal circuit 14, respectively. 

[0091] In addition, in study of operation (action), signals, such as this 
angular-velocity sensor 18, an acceleration sensor 19, and 261 -26n of 
potentiometers etc., are used so that it may mention later. 

[0092] A digital disposal circuit 14 incorporates sensor data, and the image data 
and voice data which are supplied from each above-mentioned sensor one by 



one, and carries out sequential storing of these through an internal bus 15 in the 
predetermined location in DRAM11, respectively. Moreover, a digital disposal 
circuit 14 incorporates the dc-battery residue data showing the dc-battery 
residue supplied from a dc-battery 17 with this one by one, and stores this in the 
predetermined location in DRAM11. 

[0093] Thus, each sensor data stored in DRAM11, image data, voice data, and 
dc-battery residue data are used in case CPU 10 performs motion control of this 
robot equipment 1 after this. 

[0094] CPU 10 stores direct read-out and this in DRAM1 1 for the control program 
stored in the memory card 28 or flash ROM 12 with which the PC Card slot 
which the idiosoma unit 2 does not illustrate was loaded through the PC card 
interface circuitry 1 3 at the time of the first stage when the power source of robot 
equipment 1 was switched on in practice. 

[0095] Moreover, CPU10 judges [ after this ] the situation of self and a perimeter, 
the existence of the directions from a user, and influence, etc. from a digital 
disposal circuit 14 based on each sensor data by which sequential storing is 
carried out, image data, voice data, and dc-battery residue data to DRAM11 as 
mentioned above. 

[0096] Furthermore, CPU 10 can make the head unit 4 able to shake vertically 
and horizontally, can move tail 5A of the tail section unit 5, or makes it act by 



making the required actuators 251 -25n drive based on the decision result 
concerned to nnake it walk by making each leg unit 3A-3D drive etc. while it opts 
for the action which continues based on the control program stored in this 
decision result and DRAM1 1 . 

[0097] Moreover, in this case, CPU 10 generates voice data if needed, by giving 
this to a loudspeaker 24 as a sound signal through a digital disposal circuit 14, 
makes the voice based on the sound signal concerned output outside, or turns 
on, switches off or blinks above-mentioned LED. 

[0098] Thus, in this robot equipment 1, it is made as [ act / according to the 
situation of self and a perimeter the directions from a user, and influence / it / 
autonomously ]. 

[0099] (2) the software configuration of a control program - here comes to show 
the software configuration of the above-mentioned control program in robot 
equipment 1 to drawing 9 . In this drawing 9 , the device driver layer 30 is located 
in the lowest layer of this control program, and consists of device driver sets 31 
which consist of two or more device drivers. In this case, each device driver is 
the object allowed ** which carries out direct access to the hardware used by 
usual computers, such as CCD camera 20 ( drawing 8 ) and a timer, and 
processes in response to interruption from corresponding hardware. 
[0100] Moreover, the ROBOTIKKU server object 32 With the virtual robot 33 



which becomes by the software group which offers the interface for being 
located in the lowest layer of the device driver layer 30, for example, accessing 
hardware, such as various above-mentioned sensors and Actuators 251 -25n 
With the BAWA manager 34 who becomes by the software group which 
manages the change of a power source etc. It consists of a device driver 
manager 35 who becomes by the software group which manages other various 
device drivers, and a dither IN DO robot 36 which becomes by the software 
group which manages the device of robot equipment 1. 

[0101] The manager object 37 consists of an object manager 38 and a service 
manager 39. The object manager 38 is a software group which manages starting 
and termination of each software group contained in the ROBOTIKKU server 
object 32, the middleware layer 40, and the application layer 41, and a service 
manager 39 is a software group which manages connection of each object 
based on the initial entry between each object described by the connection file 
stored in the memory card 28 ( drawing 8 ). 

[0102] The middleware layer 40 is located in the upper layer of the ROBOTIKKU 
server object 32, and consists of software groups which offer the fundamental 
function of these robot equipments 1, such as an image processing and speech 
processing. Moreover, the application layer 41 is located in the upper layer of the 
middleware layer 40, and consists of software groups for opting for action of 



robot equipment 1 based on the processing result processed by each software 
group which constitutes the middleware layer 40 concerned. 
[0103] In addition, the concrete software configuration of the middleware layer 
40 and the application layer 41 is shown in drawing 10 , respectively. 
[0104] As shown in drawing 10 . the middleware layer 40 For noise detection, 
The object for temperature detection, the object for brightness detection, the 
object for scale recognition, the object for distance detection, for posture 
detection, The recognition system 60 which has the input semantics converter 
module 59 etc. in the object for touch sensors, the object for motion detection, 
and each signal conditioning module 50 for color recognition - 58 lists, It consists 
of output systems 69 which have each signal conditioning modules 61-67 for the 
object for posture management, the object for tracking, the object for motion 
playback, the object for a walk, the object for a fall return, the object for LED 
lighting, and sound playback etc. in output semantics converter module 68 list. 
[0105] Each signal conditioning modules 50-58 of the recognition system 60 
incorporate the data with which it corresponds of each sensor data read from 
DRAM1 1 ( drawing 8 ) by the virtual robot 33 of the ROBOT! KKU server object 
32, or image data and voice data, perform predetermined processing based on 
the data concerned, and give a processing result to the input semantics 
converter module 59. Here, the virtual robot 33 is constituted by the 



predetermined protocol as a part which carries out transfer or conversion of a 
signal. 

[0106] The input semantics converter module 59 It is based on the processing 
result given from each [ these ] signal conditioning modules 50-58. "The fall was 
detected", [ "it is "noisy", hot / "hot" /, and bright", "the ball having been detected", 
and ] The self of "it was stroked", "it having been struck", "the scale of C-E-G 
having been heard", "the body which moves having been detected", "having 
detected the obstruction", etc. and a surrounding situation, the command from a 
user, and influence are recognized, and a recognition result is outputted to the 
application layer 41 ( drawing 8 ). 

[0107] Application layer 41., as shown in drawing 1 1 , it consists of five modules, 
the behavioral model library 70, the action change module 71, the study module 
72, the feeling model 73, and the instinct model 74. 

[0108] As shown in drawing 12 , "a fall return is carried out" and when [ "when a 
dc-battery residue decreases, and avoiding an obstruction" ], the behavioral 
model library 70 is made to correspond to the condition item of the shoes "**** 
expressing feeling", "at the time of detecting a ball", etc. chosen beforehand, 
respectively, and the behavioral models 701 -70n which became independent, 
respectively "are formed" in it. 

[0109] And these behavioral models 701 -70n The time of a recognition result 



being given from the input semantics converter module 59, respectively, The 
parameter value of the corresponding emotion currently held like the 
after-mentioned at the feeling model 73 if needed when fixed time amount has 
passed, after the last recognition result is given, It opts for the action which 
continues while referring to the parameter value of the corresponding desire 
currently held at the instinct model 74, respectively, and a decision result is 
outputted to the action change module 71. 

[0110] In the case of the gestalt of this operation, in addition, each behavioral 
models 701-70n As the technique of opting for the next action As opposed to the 
arc ARC1 - ARCn which connect between to each node NODEO - NODEn for to 
other nodes NODEO of which - NODEn it changes from one node (condition) 
NODEO as shown in drawing 13 - NODEn The algorithm called the finite 
stochastic automaton determined probable based on the transition probability 
P1-Pn set up, respectively is used. 

[0111] Concretely, each behavioral models 701-70n are made to correspond to 
the node NODEO which forms the self behavioral models 701-70n. respectively - 
NODEn, respectively, and have the state transition table 80 as shown in drawing 
14 for every these node NODEO - NODEn. 

[0112] In this state transition table 80, the input event (recognition result) made 
into transition conditions in that node NODEO - NODEn is listed by the line of an 



"input event name" at a priority, and the further conditions about that transition 
condition are described by the "data name" and the corresponding train in the 
line of the "data range." 

[011 3] therefore, in the node NODE100 expressed in the state transition table 80 
of drawing 14 When the recognition result of "detecting a ball (BALL)" is given 
The range of "magnitude (SIZE)" of the ball given with the recognition result 
concerned is "0 to 1000", When the recognition result of "detecting an 
obstruction (OBSTACLE)" is given, they have been conditions for that the range 
of "the distance (DISTANCE)" to the obstruction done with the recognition result 
concerned is "0 to 100" to change to other nodes. 

[0114] Moreover, in this node NODE100, when there is no input of a recognition 
result, it also sets. The inside of each emotion held at the feeling model 73 and 
the instinct model 74 which 701-70n of behavioral models refers to periodically, 
respectively, and the parameter value of each desire, it was held at the feeling 
model 73 - "- glad (JOY) " - surprised (SURPRISE) " or - "- feeling 
sad (SADNESS) - " - when the range of one of parameter value is "50 to 100", 
it can change to other nodes. 

[0115] moreover - a state transition table 80 - "- others, while the node name 
which can change from the node NODEO - NODEn in the train of the "transition 
place node" in the column of transition probability" of NODOHE is listed It is 



described by the part where it corresponds in the column of transition probability" 
of NODOHE, respectively, the transition probability to each of other node 
NODEO which can change when all the conditions described by the line of an 
"input event name", a "data value", and the "range of data" are met - NODEn -- 
"— others -- the action which should be outputted in case it changes to the node 
NODEO - NODEn "— others — it is described by the line of "output action" in the 
column of transition probability" of NODOHE. in addition -- "-- others — the sum 
of the probability of each line in the column of transition probability" of NODOHE 
is 100 [%]. 

[01 16] therefore, in the node NODE100 expressed in the state transition table 80 
of drawing 14 for example, when the recognition result that it carries out 
"detecting a ball (BALL)", and the range of "SIZE (magnitude)" of the ball is "0 to 
1000" is given It can change to "a node NODE 120 (node 120)" by the probability 
of "30 [%]", and action of "ACTION1 " will be then outputted. 
[0117] When they are constituted as a lot of nodes NODEO described as such 
[ respectively ] a state transition table 80 - NODEn(s) are connected, and a 
recognition result is given from the input semantics converter module 59, each 
behavioral models 701 -70n opt for the next action probable using the state 
transition table of the node NODEO - NODEn, and are made as [ output / to the 
action change module 71 / a decision result ]. 



[0118] The action change module 71 shown in drawing 11 chooses from each 
behavioral models 701-70n of the behavioral model library 70 the action 
outputted from the high behavioral models 701 -70n of the priority beforehand 
defined among the actions outputted, respectively, and sends out the command 
(this is hereafter called action command.) of the purport which should perform 
the action concerned to the output semantics converter module 68 of the 
middleware layer 40. In addition, in the gestalt of this operation, priority is set up 
highly about 701 -70n of behavioral models written by the bottom in drawing 12 . 
[0119] Moreover, the action change module 71 notifies that the action was 
completed based on the completion information of action given from the output 
semantics converter module 68 after the completion of action to the study 
module 72. the feeling model 73, and the instinct model 74. 
[0120] On the other hand, the recognition result of the instruction received as 
influence from a user, such as the study module 72 "was struck" among the 
recognition results given from the input semantics converter module 59 and "it 
having been stroked", is inputted. 

[0121] And based on the notice from this recognition result and the action 
change module 71, the study module 72 reduces the manifestation probability of 
that action, when "struck" (scolded), and when "stroked" (praised), it changes 
corresponding behavioral models [ in the behavioral model library 70 / 701 -70n ] 



corresponding transition probability so that the manifestation probability of that 
action may be raised. 

[0122] on the other hand, the feeling model 73 - glad Qoy) " - feeling 
sad (sadness) ~ " — getting angry (anger) - " — surprised (surprise) — " — 
"dislike (disgust)" — and — "— afraid (fear) — " — the parameter with which the 
strength of the emotion is expressed for every emotion is held about a total of six 
emotions. And the feeling model 73 updates the parameter value of each 
[ these ] emotion periodically based on the notice from the specific recognition 
result to which it is given from the input semantics converter module 59, 
respectively, such as "it having been struck" and "it having been stroked", and 
elapsed time and the action change module 71 etc. 

[0123] The recognition result to which the feeling model 73 is specifically given 
from the input semantics converter module 59, The amount of fluctuation of the 
action and its emotion when being computed by predetermined operation 
expression based on the elapsed time after updating last time etc. of the robot 
equipment 1 at that time **E [t], The multiplier which expresses the sensibility of 
E [t] and its emotion for the parameter value of the current emotion is set to ke. 
(4) By the formula, as parameter value [ of the emotion in the following period ] E 
[t+1] is computed and this is replaced with parameter value [ of the current 
emotion ] E [t], the parameter value of the emotion is updated. Moreover, the 



feeling model 73 updates the parameter value of all emotions like this. 

[0124] 

[Equation 4] 

E[t+l]=E[l]+keXAE[l] 



[0125] In addition, it is decided beforehand what the notice from each recognition 
result or the output semantics converter module 68 has effect of on amount of 
fluctuation **[ of the parameter value of each emotion ] E [t]. For example, the 
recognition result of "having been struck" has big effect on amount of fluctuation 
**[ of the parameter value of the emotion of the "resentment" ] E [t], and the 
recognition result of "having been stroked" has big effect on amount of 
fluctuation **[ of the parameter value of the emotion of "joy" ] E [t]. 
[0126] Here, the notice from the output semantics converter module 68 is the 
so-called feedback information (the completion information of action) of action, 
and is the information on the appearance result of action, and the feeling model 
73 changes feeling also using such information, this — for example, the feeling 
level of the resentment falls by action of "barking" - like - they are things. In 
addition, the notice from the output semantics converter module 68 is inputted 
also into the study module 72 mentioned above, and the study module 72 



changes behavioral models [ 701 -70n ] corresponding transition probability 
based on the notice. 

[0127] In addition, feedback of an action result may be made with the output 
(action to which feeling was added) of the action change modulator 71 . 
[0128] on the other hand, "movement avarice (exercise)", "love avarice 
(affection)", "appetite (appetite)", and "the curiosity (curiosity) of the instinct 
model 74" are mutually-independent - the parameter with which the strength of 
the desire is expressed for these the desires of every is held about four desires 
the bottom. And the instinct model 74 updates the parameter value of these 
desires periodically based on the recognition result to which it is given from the 
input semantics converter module 59, respectively, the notice from elapsed time 
and the action change module 71, etc. 

[0129] The instinct model 74 specifically about "movement avarice", "love 
avarice", and "curiosity" The amount of fluctuation of that the desire of the when 
being computed by predetermined operation expression based on the notice 
from a recognition result, elapsed time, and the output semantics converter 
module 68 etc. deltal [k]. The parameter value of the current desire as a 
multiplier ki showing the sensibility of I [k] and its desire As parameter value [ of 
that desire in the following period ] I [k+1] is computed using (5) types with a 
predetermined period and this result of an operation is replaced with parameter 



value [ of that current desire ] I [k], the parameter value of that desire is updated. 
Moreover, the instinct model 74 updates the parameter value of each desire 
except "appetite" like this. 
[0130] 
[Equation 5] 

I[k-M]=I[k]+ki xAI[k] • • • (5) 

[0131] In addition, it is decided beforehand what the notice from a recognition 
result and the output semantics converter module 68 etc. has effect of on 
amount of fluctuation **[ of the parameter value of each desire ] I [k], for example, 
it has effect to amount of fluctuation **[ of the parameter value of the "fatigue" ] I 
[k] with the big notice from the output semantics converter module 68. 
[0132] In addition, in the gestalt of this operation, it is regulated so that each 
emotion and the parameter value of each desire (instinct) may be changed in the 
range from 0 to 100, respectively, and the value of multipliers ke and ki is also 
set up according to the individual for each [ an emotion and ] the desire of every. 
[0133] On the other hand, abstract action commands, such as it being [ which is 
given from the action change module 71 of the application layer 41 as mentioned 
above ] "advance", "it being glad", the output semantics converter module 68 of 
the middleware layer 40 "cries", as shown in drawing 10 , or "tracking (a ball is 



pursued)", are given to the signal conditioning modules 61-67 with which the 
output system 69 corresponds. 

[0134] And these signal conditioning modules 61-67 The servo command value 
which should be given to the actuators 251 -25n ( drawing 8 ) in order to perform 
the action based on the action command concerned, if an action command is 
given, Or the drive data given to LED of a "eye" are generated, the voice data of 
the sound outputted from a loudspeaker 24 ( drawing 8 ) - and - Sequential 
sending out of these data is carried out at the actuators 251 -25n which 
correspond through the virtual robot 33 and digital disposal circuit 14 ( drawing 
8 ) of the ROBOTIKKU server object 32 one by one, a loudspeaker 24. or LED. 
[0135] Thus, in robot equipment 1, it is made based on the control program as 
[ perform / the situation of self (interior) and a perimeter (exterior), the directions 
from a user, and autonomous action according to influence ]. 
[0136] (3) When the change robot equipment 1 of the instinct and feeling 
according to an environment "is still brighter" in a perimeter, it becomes cheerful, 
and to this, when dark [ "dark" ] in a perimeter, it is made as [ change / according 
to the degree of three conditions (henceforth an environmental condition), the 
"noise" of the surrounding environments, "temperature", and a "illuminance", 
such as becoming calm, / feeling and instinct ]. 

[0137] That is, the temperature sensor (not shown) for detecting surrounding 



temperature to robot equipment 1 in addition to CCD camera 20 mentioned 
above as an external sensor for detecting a surrounding situation, a distance 
robot 22, a touch sensor 21, a microphone 23, etc. is formed in the 
predetermined location. As a corresponding configuration, each signal 
conditioning modules 50-52 for the object for noise detection, the object for 
temperature detection, and brightness detection are formed in the recognition 
system 60 of the middleware layer 40. 

[0138] The signal conditioning module 50 for noise detection detects 
surrounding noise level based on the voice data from the microphone 23 
( drawing 8 ) given through the virtual robot 33 of the ROBOTIKKU server object 
32, and outputs a detection result to the input semantics converter module 59. 
[0139] The signal conditioning module 51 for temperature detection detects 
surrounding temperature based on the sensor data from the temperature sensor 
given through the virtual robot 33, and outputs a detection result to the input 
semantics converter module 59. 

[0140] The signal conditioning module 52 for brightness detection detects a 
surrounding illuminance based on the image data from CCD camera 20 
( drawing 8 ) given through the virtual robot 33, and outputs a detection result to 
the input semantics converter module 59. 

[0141] The input semantics converter module 59 recognizes the degree of 



surrounding "noise", "temperature", and a "illuminance" based on the output of 
each [ these ] signal conditioning modules 50-52, and outputs the recognition 
result concerned to the inner statement-model section of the application module 
41 ( drawing 1 1 ) as mentioned above. 

[0142] Concretely, the input semantics converter module 59 recognizes the 
degree of the surrounding "noise" based on the output of the signal conditioning 
module 50 for noise detection, and outputs "it being noisy" or the recognition 
result of "being quiet" to the feeling model 73 and instinct model 74 grade. 
[0143] Moreover, the input semantics converter module 59 recognizes the 
degree of surrounding "temperature" based on the output of the signal 
conditioning module 51 for temperature detection, and outputs "it being hot" or 
the recognition result of "being cold" to the feeling model 73 and instinct model 
74 grade. 

[0144] Furthermore, the input semantics converter module 59 recognizes the 
degree of a surrounding "illuminance" based on the output of the signal 
conditioning module 52 for brightness detection, and outputs "it being bright" or 
the recognition result of "being dark" to the feeling model 73 and instinct model 
74 grade. 

[0145] The feeling model 73 changes each parameter value periodically as 
mentioned above according to (4) types based on the various recognition results 



given from the input semantics converter module 59. 

[0146] And the feeling model 73 makes the value of the multiplier ke of 
corresponding (4) types about an emotion defined beforehand fluctuate based 
on the recognition result about the "noise" and the "temperature" which are given 
from the input semantics converter module 59, and a "illuminance." 
[0147] When the recognition result of "being noisy" is given, the increment in a 
predetermined number of the value of the multiplier ke to the emotion of the 
"resentment" is carried out, and when the recognition result of "being quiet" is 
given to this, specifically, as for the feeling model 73, predetermined number 
reduction of the value of the multiplier ke to the emotion of the "resentment" is 
carried out. By this, it will be influenced by surrounding "noise" and the 
parameter value of the "resentment" will change. 

[0148] Moreover, the feeling model 73 carries out predetermined number 
reduction of the value of the multiplier ke to the emotion of "Joy", when the 
recognition result of "being hot" is given, and when the recognition result of 
"being cold" is given to this, it carries out the increment in a predetermined 
number of the value of the multiplier ke to the emotion of "sadness." By this, it 
will be influenced by surrounding "temperature" and the parameter value of 
"sadness" will change. 

[0149] furthermore, the feeling model 73 carries out the increment in a 



predetermined number of the value of the multiplier ke to the emotion of "joy", 
when the recognition result of "being bright" is given — making — this — receiving 
— [— it is dark — " -- ** — when the said recognition result is given, the increment 
in a predetermined number of the value of the multiplier ke to the emotion of 
"fear" is carried out. By this, it will be influenced by surrounding "illuminance" and 
the parameter value of "fear" will change. 

[0150] The instinct model 74 changes the parameter value of each desire 
periodically as mentioned above like this according to (5) types based on the 
various recognition results given from the input semantics converter module 59. 
[0151] Moreover, the instinct model 74 makes the value of the multiplier ki of (5) 
types of the corresponding desire defined beforehand fluctuate based on the 
recognition result about the degree of the "noise" and the "temperature" which 
are given from the input semantics converter module 59, and a "illuminance." 
[0152] When the recognition result of "being "noisy" and bright" is given, 
predetermined number reduction of the value of the multiplier ki to the "fatigue" is 
carried out, and when the recognition result of "being "quiet" and dark" is given 
to this, specifically, as for the instinct model 74, the increment in a 
predetermined number of the value of the multiplier ki to the "fatigue" is carried 
out. Moreover, the instinct model 74 carries out the increment in a 
predetermined number of the value of the multiplier ki to the "fatigue", when "it 



being hot" or the recognition result of "being cold" is given. 
[0153] consequently, when action of robot equipment 1 "has" a noisy perimeter 
Since it is easy to increase the parameter value of the "resentment" and the 
parameter value of the "fatigue" becomes easy to decrease It becomes the 
action in which action carried out "since" as a whole, and to this, since [ whose a 
perimeter is "quiet" ] the parameter value of the "resentment" tends to decrease 
and it occasionally becomes easy to increase the parameter value of the 
"fatigue", action turns into action "fallen and attached" as a whole. 
[0154] moreover, when action of robot equipment 1 "is hot" in a perimeter Since 
the parameter value of "joy" tends to decrease and it becomes easy to increase 
the parameter value of the "fatigue" Action turns into "lazy" action [ like ] as a 
whole, and since it is easy to increase the parameter value of "sadness" when 
cold [ "cold" ] in a perimeter, and it becomes easy to increase the parameter 
value of the "fatigue" to this, action turns into action "which feels the cold" as a 
whole. 

[0155] moreover, when action of robot equipment 1 "is bright" in a perimeter 
Since it is easy to increase the parameter value of "joy" and the parameter value 
of the "fatigue" becomes easy to decrease, action turns into "cheerful" action as 
a whole, and when dark [ "dark" ] in a perimeter, to this Since it is easy to 
increase the parameter value of "joy" and becomes easy to increase the 



parameter value of the "fatigue", action turns into "calm" action as a whole. 
[0156] As mentioned above, robot equipment 1 is constituted, and robot 
equipment 1 can change feeling and instinct according to an environment, and it 
can act autonomously according to the condition of the feeling and instinct. . 
[0157] (4) Explain the important section to which this invention was applied in the 
explanation above-mentioned robot equipment 1 of the whole application (4-1) of 
this invention. Robot equipment 1 is connected to a picture signal, a sound 
signal (acoustic signal), etc., action (relating) is learned, and after study is 
constituted so that the picture signal and sound signal which were tied up may 
cause action. Although the following explanation mainly explains the example 
which connects voice to action as study, it cannot be overemphasized that an 
image can be connected to action, either. Specifically, robot equipment 1 has the 
following configurations for implementation of this invention. Robot equipment 1 
is equipped with the speech recognition section 101, the sensor processing 
section 102, the instinct emotion section 103, the associative remembrance 
storage section 104. and the action generation section 105 as shown in drawing 
15 . 

[0158] The speech recognition section 101 functions here as an input detection 
means to detect the information inputted the contact detection by the touch 
sensor (touch sensor 21 grade shown in drawing 8 ) made into a contact 



detection means to detect contact, coincidence, or before and after time. The 
associative remembrance storage section 104 functions as a storage means to 
tie up and memorize the action which appeared according to contact, and the 
input (sound signal) which the speech recognition section 101 detected. The 
action generation section 105 Based on the newly acquired input (sound signal), 
it functions as a behavior control means which carries out action of which the 
associative remembrance storage section 104 was reminded. Moreover, the 
sensor processing section 102 has a function as an action appearance means to 
make action appear according to the contact detection by the touch sensor 
which is not illustrated for example. Specifically, each component functions as 
follows. 

[0159] The speech recognition section 101 carries out speech processing of the 
sound signal inputted from the outside (microphone 23), and recognizes it as 
predetermined language. HMM is used for the speech recognition section 101, it 
is constituted, and, specifically, recognizes the inputted voice as a phoneme 
sequence by two or more recognition classes depended on HMM. 
[0160] Moreover, in the speech recognition section 101, it is possible to also 
make a class increase from the existing class by study. For example, as shown 
in (B) among drawing 9 , when the input of the voice which cannot be recognized 
is made, the existing class is divided and a new class is generated. The existing 



class with high reliability (affiliation evaluation) is specifically divided to the 
inputted voice, and a new class is generated. For example, in division of a class, 
the low part of the description nature is divided as a new class in the class 
concerned. It not only can recognize by this the language registered beforehand, 
but it can recognize new language now. 

[0161] The sensor processing section 102 generates the signal of the taught 
actuation (action) based on change of a sensor signal. That is, the sensor 
processing section 102 recognizes the inputted action information. 
[0162] For example, about the actuation taught, it may be based on the actuation 
set up beforehand and may be based on the actuation newly set up by the user. 
Moreover, some can be chosen of the already set-up actions and it can generate. 
[0163] Instruction of the actuation set up beforehand is that actuation is taught 
by making the input of the sensor signal from a touch sensor into a trigger 
(ignition), for example, — ", when the predetermined touch sensor which stood 
and was formed in back back in posture" is pushed making a "stability posture" 
change - beforehand - setting up - an actual scene setting - "- when the 
touch sensor which stands and is formed in such back back in posture" is 
pushed, the transition to a "stability posture" comes out so that it may say that it 
is taught as actuation. 

[0164] In addition, about the location in which the sensor for teaching such 



actuation is formed, metaphors may be a head, a leg tip, etc. Thus, by forming a 
sensor in arbitration, it becomes possible to teach various actuation. 
[0165] Moreover, carrying out as instruction of the actuation performed by 
setting up newly using change of the signal which controls a right hand side (joint 
section), for example etc. is mentioned. Right hand sides are the actuators 
(servo motor etc.) 251 -25n formed in the joining segment of tail 5A of the tail 
section unit 5 etc. at the joining segment of the joint part of each leg unit 3A-3D, 
each joining segment of each leg unit 3A-3D and the idiosoma unit 2, the head 
unit 4. and the idiosoma unit 2, and the list, as mentioned above. 
[0166] For example, when a user moves the right hand side of robot equipment 1 
compulsorily, a load is generated in the right hand side concerned. The signal 
which differs from the usual actuation (actuation without an external load) with 
the load to a right hand side at this time, for example, the servo signal to the right 
hand side concerned, occurs. If based on such a signal, it is possible to grasp 
transition of a posture, i.e., actuation. Since it is such, the actuation made to 
change compulsorily by the user can be learned as new actuation by 
memorizing such a signal. Instruction of such new actuation is explained in full 
detail later. In addition, although it is explaining in full detail further later, robot 
equipment 1 detects external force (external load) from change of such a signal 
by this invention, and it is made as [ said / it / that the external force concerned 



was learned ]. 

[0167] Furthermore, the sensor processing section 102 can also carry out class 
recognition of the action to learn. For example, from the characteristic quantity in 
an action feature space, class recognition can be carried out and the inputted 
action information can also be learned. 

[0168] The instinct emotion section 103 is a part in which the information on the 
emotion connected to voice which was mentioned above, or action is stored. 
That is, the instinct information bureau 103 is changing the instinct and feeling 
with the sensor signal inputted by an instinct model and the feeling model, as 
mentioned above, 

[0169] The associative remembrance storage section 104 learns based on the 
information from the speech recognition section 101 which was mentioned 
above, the sensor processing section 102, and the instinct emotion section 103, 
and generates the action information corresponding to the voice further inputted 
based on the study after study, or an image. For example, the associative 
storage of the conventional technique which connects the image explained using 
(1) type and (2) types and the class of a sound as a matrix of correlation is used 
for the associative remembrance storage section 104, and it is carrying out 
associative storage of each information. 

[0170] For example, as the sensor processing section 102 mentioned above, the 



associative remembrance storage section 104 from a sensor output — when 
stand, instruction of actuation of the transition to a "stability posture" from 
posture" is detected, coincidence or time amount is got mixed up and the speech 
recognition section 101 has recognized the language of "stability" the 
associative remembrance storage section 104 - "— it stands, and actuation of 
the transition to a "stability posture" from posture" and the utterance of "stability" 
are tied up and memorized (study). This is what it is generally made as 
instruction of the "stability" to the dog of an animal. 

[0171] Moreover, only when the language inputted as the inputted actuation is 
beforehand set up as a pair, the associative remembrance storage section 104 
ties up the actuation and language, and can learn them (igniting). For example, if 
instruction, coincidence, or time amount of the so-called actuation of "stability" 
which was mentioned above is got mixed up and the language of "stability" is 
inputted, the actuation will be learned (it connects and memorizes), but to the 
other language, if actuation is not learned, say. 

[0172] Moreover, the associative remembrance storage section 104 can be 
associated and can also be learned by carrying out the instinct and feeling which 
are outputted to the recognized actuation or language from the instinct emotion 
section 103. For example, when voice (language) is inputted at the time of study, 
and fear is sensed, such feeling can also be tied up and learned to such voice. 



[0173] As mentioned above, the associative remembrance storage section 104 
relates, learns by carrying out voice, actuation, or feeling (connecting), and 
comes to generate action information after study corresponding to an image, 
voice, etc. which were inputted based on such a study result. 
[0174] The action generation section 105 generates action based on the action 
information outputted from such the associative remembrance storage section 
104. for example, - the case where the language of "stability" is inputted for the 
associative remembrance storage section 104 after study of instruction of 
"stability" which was mentioned above - "- it stands and the action to a "stability 
posture" from posture" made to change is made to appear (it is made to cause) 
[0175] Thus, robot equipment 1 can connect speech information and change of a 
sensor signal, can learn actuation, and can discover action (actuation) now as a 
study result based on the voice inputted. 

[0176] For example, a series of processings in robot equipment 1 until it learns 
and outputs actuation of "stability" are as follows. 

[0177] At the time of study, as shown in (A) among drawing 16 , robot equipment 
1 gets mixed up a sound signal (acoustic signal), coincidence, or time amount, 
and a contact signal is given. As a sound signal, "stability" is inputted, for 
example, moreover - giving a contact signal "- it is equivalent to standing and 
giving change to the sensor signal of the right hand side which participates in the 



actuation by instruction of actuation of the transition to a "stability posture" from 
posture." In addition, as mentioned above, a touch sensor or a press carbon 
button (for example, stability instruction carbon button) is prepared in a 
predetermined part, by actuation (press) of this touch sensor, such actuation can 
also be taught and giving a contact signal means generating of the signal by 
actuation of such a touch sensor in this case. 

[0178] The actuation which changes by such study actuation as robot equipment 
1 is shown all over this drawing (A-2) out of drawing 16 (A-1) is taught. 
[0179] And by giving the language taught at the time of study (acoustic signal), 
for example, "stability", as shown in (B-1) of (B) among drawing 16 after study, 
robot equipment 1 comes to change into the posture of the "stability" made into 
the same posture as the Inside of drawing 16 taught at the time of study (A-2), as 
shown in drawing 16 (B-2). 

[0180] Moreover, about the actuation to teach, it is not limited to actuation which 
was mentioned above. That is, or it pushes upward the bottom of the neck which 
gets mixed up voice input (utterance), coincidence, or time amount, for example, 
pushes the back of robot equipment 1 ahead, and it pushes down, actuation of 
raising the nose gear can also be taught. It becomes instruction of actuation, 
such as "lie down", "stand", or a "hand", by connecting the source language to 
instruction of such actuation. 



[0181] Moreover, for example, robot equipment 1 can also carry out the following 
study. 

[0182] First, robot equipment 1 learns the actuation "to kick" as study of action. 
The nose-gear section is operated by the user (informer) and, specifically, 
actuation of "kicking" is learned in an object. Study of operation may be based 
on the actuation set up beforehand, and may be based on new actuation. On the 
other hand, the language "a-ka" obtained according to the language recognition 
and the red by whom image recognition was done are made to correspond, and 
it memorizes. 

[0183] As such a study result, robot equipment 1 generates "dirt and the 
actuation which can kick, carries out speech recognition of the utterance of ", 
and is kicked by action generation to a "red" body. For example, specification of 
a red object carries out the segmentation of the input image, and is performed by 
specifying a red part. That is, the body equivalent to red which carried out the 
segment is specified as an object. 

[0184] Moreover, with the gestalt of above-mentioned operation, although 
information connected to action is made into speech information, it is not limited 
to this. For example, image information can be connected to action information. 
It has the image recognition section for recognizing a specific image in this case 
from the picture signal from the image pick-up means of CCD camera 20 grade. 



[0185] Moreover, although the case where it is connected with the gestalt of 
above-mentioned operation to the action and language which had the instinct or 
the emotion outputted from the instinct emotion section 103 learned is explained, 
it is not limited to this. For example, the instinct and the emotion which were 
generated in late-coming can also be made to link to the action and language 
which are set up beforehand. 

[0186] Furthermore, robot equipment 1 can also memorize the inputs (for 
example, language, an image, etc.) used as the emotion caused by the output 
(actual action) and its cause, and the output concerned (study). Thereby, robot 
equipment 1 recollects the memorized corresponding emotion from the input of 
language etc., and it can also make predetermined action appear in the actual 
scene after study, without outputting the place which should carry out the output 
corresponding to such an input, if it is original (action). 

[0187] for example, the thing for which the emotion of fear to which it was 
caused when robot equipment 1 touched a certain red thing (input) (action), for 
example, a feeling by having sensed heat, (emotion) is memorized (study) ~ a 
behind red thing - only seeing (there having been an input) - fear is recollected 
and the fear can be made to be able to express as action (predetermined action 
is taken) That is, other suitable actuation is made to appear, without appearing 
actuation of the past of touching a red thing. 



[0188] For example, it functions as a storage means tie up and memorize the 
action result information which shows the result to which the above-mentioned 
associative remembrance storage section 104 acted according to the sound 
signal which the speech-recognition section 101 detected in such a case, and 
the sound signal concerned, and it functions as a behavior-control means act 
based on the action result information which the associative remembrance 
storage section 104 specified, based on the sound signal into which the action 
generation section 105 was newly inputted. 

[0189] Moreover, robot equipment 1 can have effect of the space of other inputs, 
an emotion, and action on the feature space of an input signal, and can also 
affect the class classification of the input signal concerned. That is, as shown in 
(A) and (B) among drawing 12 , when the class approximates in the feature 
space of an image and a sound for example, the class classification of an image 
and a sound is carried out with reference to the 3rd feature space (for example, 
feature space of action). 

[0190] As opposed to the input of the 1st object (image) specifically 
characterized with the picture signal When a compensation (for example, 
"stroked") is obtained when the 1st action is taken, and the 1st action is similarly 
taken to the 2nd object very near the 1st object in an image feature space as a 
result of a class classification (purport approximated in an image feature space), 



it is punishment (for example). When it obtains [ "it was knocked" and ], on the 
occasion of the input of the 2nd object on and after next time, it takes except the 
1st action. That is, using the result (here action result) of the class classification 
in other feature spaces, the classification of other classes is affected or the 
strategy of a class classification is changed into it. 

[0191] For example, in such a case, the speech recognition section 101 has a 
function as an information classification means to classify a sound signal, based 
on an input detection means, a characteristic quantity detection means to detect 
the characteristic quantity of the sound signal which the input detection means 
detected, and characteristic quantity. Here, with the classification of the sound 
signal based on characteristic quantity, it corresponds to the class classification 
by HMM. In addition, the function as a characteristic quantity detection means is 
realized by the characteristic quantity extract section 122 shown in drawing 33 
explained in full detail later, and the function as an information classification 
means is realized by the HMM section 123 shown in drawing 33 . 
[0192] Furthermore, the speech recognition section 101 will have a function as a 
reclassification means to change the classification (recognition class) of the 
sound signal which caused the action concerned, based on the action result 
information (for example, a compensation, punishment) which shows the result 
of having been controlled by the action generation section 105 and having acted. 



In addition, about study by associative storage, when praised, study which 
stimuli (voice, an innage, action, etc.) connect to the taken action can also be 
performed. 

[0193] In the above, the whole part concerning this invention in robot equipment 
1 was explained. Next, it explains still more concretely about each part. 
[0194] (4-2) The study (example of the sensor processing section) robot 
equipment 1 of actuation of arbitration is considering actuation (action) to learn 
as the actuation set up beforehand or actuation of arbitration, as mentioned 
above. Here, study of actuation of arbitration, i.e., study of new actuation, is 
explained. 

[0195] As robot equipment 1 was mentioned above, each joint is controlled by 
the servo motor. Robot equipment 1 generates the include-angle time series of 
each joint by include-angle assignment (include-angle assignment information) 
from CPU 10, and is outputting actuation as the result. 

[0196] Moreover, the pulse signal given to the include angle of an actual joint 
and the motor by the potentiometer attached to the joint as a signal from the 
servo control section can be obtained. Instruction of actuation of arbitration is 
used instead of sensor signals, such as a touch sensor which teaches actuation 
which mentioned such a pulse signal above, and which is set up beforehand, 
and is performed. 



[0197] Robot equipment 1 is among drawing 17 as a concrete configuration for 
learning actuation of such arbitration. As shown in (A), it has the discernment 
section 111. Here, the discernment section 111 serves as an example in the 
case of being constituted in order that the sensor processing section 102 shown 
in drawing 15 may learn actuation of arbitration. The discernment section 111 
learns actuation based on the pulse width of the control signal to each joint 
motor. 

[0198] By the way, since [ which is ] robot equipment 1 is made as [ change / into 
each posture ], it has not stopped at the fixed posture in the case of study of 
operation, in this case - it is necessary to stand and to make the same 
actuation learn in each posture, such as posture" and a "stability posture" 
Therefore, when teaching actuation with the pulse width which controls a right 
hand side Qoint section), it is necessary to carry out, when each posture has 
been grasped. 

[0199] Since it is such, the discernment section 1 1 1 is equipped with two or more 
discrimination circuits 1111 and 1112 and ... according to each posture, as 
shown in (B) among drawing 17 . for example, the 1st discrimination circuit 1111 
— the object for the study of operation at the time of a "stability posture", and the 
2nd discrimination circuit 1112 - "- standing - posture" - the object for the 
study of operation at the time — as — it comes out. 



[0200] In this way, based on attitude information current from two or more 
discrimination circuits 1111 and 1112 and the discernment section 111 is 
switched to the desired discrimination circuit of 1, and learns actuation in an 
arbitration posture. 

[0201] In addition, the attitude information which is the information on the 
present posture can be recognized from the information acquired from each 
potentiometers 261 -26n, the angular-velocity sensor 18, or an acceleration 
sensor 19. for example, gravity information. Moreover, based on the command 
outputted as a control signal of a right hand side, the present attitude information 
can also be acquired from the action generation section 105. 
[0202] The comparison with the pulse width in the condition of having not given 
external force performs study. Although the pulse width to which each joint takes 
this in the usual condition serves as a pattern regular in a certain amount of error 
range, when external force is added, the pattern differs from the usual thing. 
Such relation is used and the information on the actuation learned is acquired 
from the difference between the usual actuation and the pattern at the time of 
applying external force and teaching actuation. Specifically, actuation is learned 
as follows. 

[0203] For example, it stands from attitude information, the pulse width when 
applying external force to the 1st discrimination circuit 1111 for study of 



operation, when recognized as it being a posture is given as information, and the 
information assigned to coincidence at the actuation is given. For example, as 
shown in (6) types, the signal used as the so-called PID control is used for the 
pulse width used in study of operation. And specifically, the pulse width by which 
PWM control was carried out is used. 
[0204] 
[Equation 6] 

P=PgXe,^I,x|:e,At-fDgX ^"^^'-"^ ... (6) 

[0205] Here, ei is an error value (difference of the target include angle of a 
potentiometer, and a current include angle (actual include angle)) in time of day i, 
and Pg, Ig, and Dg are constants and use the P value of such (6) types. 
[0206] For example, as the pulse width to give and information on of operation, it 
considers as a vector value. For example, it considers as a 5-dimensional vector 
[VO, V1, V2, V3, V4] as information assigned to the actuation to learn. Here, five 
kinds of stimuli can be recognized now by making the element of a vector into 
five pieces, VO, V1, V2, V3, and V4. Specifically, it learns by [ as being the 
following ]. 

[0207] When the back is pushed in the direction of back (backward), 01 = [0, 1 , 0, 
0, 0] is given as the vector PI constituted from pulse width then generated, and 



information on of operation that it corresponds. For example, as shown in 
drawing 18 , the vector value (backward) P1 of pulse width, and [0, 1 , 0, 0, 0] are 
given to a discrimination circuit 1111. 

[0208] Here, each values VO, V1, V2, V3, and V4 are learned as the real number 
between 0 and 1 (floating point), and they are set to 1, so that the part stimulated 
(study) is large, as the result depended on acquisition of action by 01= [0, 1. 0, 0, 
0] - a vector - [- 0. - it is obtained as the real numbers, such as 1, 0.9, 0.2, 0.1, 
and 0.3]. 

[0209] Moreover, when the back is pushed forward, 02= [0, 0, 1, 0, 0] is given as 
the vector P2 constituted from pulse width then generated, and information on of 
operation that it corresponds. When a neck is pushed down, 03= [0, 0, 0, 1, 0] is 
given as the vector P3 constituted from pulse width then generated, and 
information on of operation that it corresponds. When a neck is pushed up 
upwards, 04= [0, 0, 0, 0, 1] is given as the vector P4 constituted from pulse 
width then generated, and information on of operation that it corresponds. And 
00= [1, 0, 0, 0, 0] is given as information on of operation that it corresponds to 
the vector PO of pulse width when external force is not added, and it as initial 
value of a posture for example, and actuation is learned as compared with this 
and the value mentioned above. 

[0210] For example, the example of pulse width is shown in drawing 19 thru/or 



drawing 25 . By this drawing 19 thru/or drawing 25 , the location of each joint is 
shown on an axis of abscissa, and the so-called value of an PWM pulse is 
shown on an axis of ordinate by it. 

[0211] Drawing 19 stands and shows the value of the pulse width (value of a 
pulse signal) in a posture. Here, "FR1" is [ the location of the 2nd joint (joint in 
the knees) and "FR3 of the location of the 1st joint (joint of a shoulder) of a 
forward right foot and "FR2"" ] the locations of the 3rd joint Qoint of an ankle) 
among drawing. Moreover, "floor linesi" is [ the location of the 2nd joint (joint in 
the knees) and "floor lineS of the location of the 1st joint (joint of a shoulder) of a 
forward left foot and "floor Iine2"" ] the locations of the 3rd joint (joint of an ankle). 
Moreover, "HR1" is [ the location of the 2nd joint Qoint in the knees) and "HR3 of 
the location of the 1st joint Qoint of a shoulder) of a right rear foot and "HR2"" ] 
the locations of the 3rd joint (joint of an ankle). Moreover, "HL1" is [ the location 
of the 2nd joint (joint in the knees) and "HL3 of the location of the 1st joint (joint 
of a shoulder) of back crus sinistrum diaphragmatis and "HL2"" ] the locations of 
the 3rd joint (joint of an ankle). Moreover, a neck consists of many joints and 
"Headi", "Head2", and "Head3" show the location corresponding to each. Also 
in the following drawing 20 thru/or drawing 25 , it is the same. Thus, in a certain 
condition (a posture or actuation), the vector value P used for the study which 
could acquire the value of the pulse width of a total of 15 pieces, namely, was 



mentioned above can be acquired as a vector value which consists of a 
15-dinriensional element. 

[0212] When It stands and the back is pushed forward in a posture When it 
became pulse width as shown in drawing 20 , and it stands and the back is back 
pushed in a posture When it became pulse width as shown in drawing 21 , and it 
stands and the head is pushed upward in a posture When it became pulse width 
as shown in drawing 22 , and it stands and the head is pushed down in a posture 
When it becomes pulse width when it becomes pulse width as shown in drawing 
23 and a right trail is held in a stability posture, as shown in drawing 24 and crus 
sinistrum diaphragmatis are held in a stability posture, it becomes pulse width as 
shown in drawing 25 . Based on such pulse width, the discernment section 
grasps a posture and learns actuation. 

[0213] Moreover, if robot equipment 1 is performed to an actual animal by having 
** and the unpleasant judging section 1 12 as shown in drawing 26 , it can learn 
actuation similarly. 

[0214] ** and the unpleasant judging section 112 distinguish the value of the 
emotion which specifies ** or dysphoria to the output from the sensor processing 
section 102. And an action emotion is outputted according to it. For example, ** 
and the unpleasant judging section 112 output the action information which 
causes the action which avoids dysphoria, when the value of the emotion which 



specifies the dysphoria in the feeling model 73 is large. For example, the back 
will be judged to be unpleasant if pushed backward, and the action information 
which changes into a "stability posture" is outputted. moreover - being 
unpleasant, if the back is pushed forward or the head is pushed down - judging 
- the action information which turns down and changes to posture" is 
outputted. Moreover, if it turns down and a neck is raised upward from a posture, 
it will judge that it is unpleasant and the action information which changes into a 
"stability posture" will be outputted. moreover - being unpleasant if a neck is 
raised upward from a stability posture - judging - the action information 
which stands and changes to posture" is outputted. That is, the above actuation 
has a large load from the outside, and is actuation discovered by sensing that it 
is unpleasant. Based on such action information, the action generation section 
105 generates action. 

[0215] Thus, by making actuation discover, if an actual dog etc. is made to learn 
a posture, similarly, the robot equipment 1 it was sensed that was unpleasant 
will change a posture itself, and will learn such transition actuation. 
[0216] In addition, study of actuation which was mentioned above is performed 
by inputting multiple times. Moreover, it learns about other postures (other 
discrimination circuits), and about the configuration of each discrimination circuit, 
the study which employed the hierarchical neural network should make, for 



example - ** - it constitutes like. For example, in the case of the neural network 
of three layers, as shown in drawing 27 , it constitutes from an input layer, an 
interlayer, and an output layer. In such a case, study is made by the following 
procedures as an outline. 

[0217] In an input layer, the sensor signal corresponding to the input layer 
concerned by which the gestalt was carried out is inputted into each neurone. In 
the middle class, the characteristic quantity of the data transmitted from each 
neurone of an input layer is extracted. Specifically, each neurone of the middle 
class extracts and evaluates the characteristic quantity paying attention to a 
certain description of input data. And an output layer makes a final decision by 
combining the description given from each neurone of an interlayer. 
[0218] Moreover, for example, study by back propagation is established, for 
example, this is adopted in a neural network of three layers who mentioned 
above, and a discrimination circuit is constituted. By this, you push the back in 
the direction of back, 01= [0, 1, 0, 0, 0] makes it input, and the value (real 
number) near [0, 1, 0, 0, 0] as an output comes to be outputted. 
[0219] Robot equipment 1 can learn actuation of arbitration by the discernment 
section 1 11 as mentioned above. Thereby, robot equipment 1 comes to discover 
the actuation learned corresponding to the utterance concerned to 
predetermined utterance (sound signal) by tying up and learning a picture signal 



and a sound signal. 
[0220] 

(4-3) In study of actuation of the study above-mentioned arbitration of the 
external force given to robot equipment, it is learning the posture at the time of 
giving external force and changing compulsorily, and the case where the 
actuation (posture) which connects to predetermined utterance etc. and is 
discovered was learned was explained. Here, study of the class of such external 
force is explained. Robot equipment 1 can discover predetermined actuation, 
when the external force learned by learning the class of external force is inputted. 
Robot equipment 1 recognizes the force input from this outside, and seems to be 
specifically able to appear stability as predetermined actuation, when the 
external force which learned the external force given to the waist and was 
learned to the waist after study is given. Hereafter, study of external force is 
explained concretely. 

[0221] As a configuration for study of external force, robot equipment 1 is 
equipped with a study means 160 make a detection means 153 detect the 
condition of the joint section 152 that external force is acting through the joint 
section 152 and the right-hand-side material 151 for operating the 
right-hand-side material 151 and the right-hand-side material 151, and the 
condition and the external force of the joint section 152 which the detection 



means 153 detected correspond, and learn them, as shown in drawing 28 . And 
robot equipment 1 can specify the class from the condition of the joint section 
152, when external force is given after study. Here, the right-hand-side material 

151 is a part driven with the actuators 251 -25n of the idiosoma unit 2. the leg 
units 3A, SB, and 3C, 3D, the idiosoma unit 2, and head unit 4 grade, as robot 
equipment 1 is shown in drawing 7 and drawing 8 . Moreover, the joint sections 

152 are such actuators 251 -25n, and, specifically, are motors which constitute 
Actuators 251-25n. 

[0222] By considering as such a configuration, robot equipment 1 is made as 
[ learn / using the pulse signal of PWM given to a motor / external force ]. As 
mentioned above, robot equipment 1 The idiosoma unit 2, the leg units 3A, 3B, 
and 3C, 3D, It considers as the right-hand-side material the idiosoma unit 2 and 
the head unit 4 grade minded the joint (joint), furthermore, the joint (the shoulder 
joint -) of plurality [ 3D / the leg units 3A, 3B, and 3C and ] While consisting of 
two or more right-hand-side material through a knee joint and an ankle joint and 
connecting the leg units 3A, 3B, and 3C and 3D with front and rear, right and left 
of the idiosoma unit 2 through a joint, respectively The head unit 4 and the tail 
section unit 5 are connected and constituted by the front end section and the 
back end section of the idiosoma unit 2 through the joint, respectively. And the 
joint which joins these right-hand-sides material possible [ actuation ] is 



constituted by Actuators 251 -25n, and the pulse signal of PWM is a signal given 
to the motor which constitutes these actuators 251 -25n. 

[0223] The value of the width of face of the pulse signal of PWM is deternnine 
according to the condition of the joint section ( motor ) 152 that external force is 
act through the right hand side material ( various units ) 151 . and it is calculate 
as an error value of the target include angle of each joint ( motor ) , and an actual 
include angle , namely , since it is such , if the force joins robot equipment 1 , an 
error value will become large , and thereby , the value of pulse width also 
becomes large . That is, the value of the pulse width of PWM becomes large 
according to the external force which joins robot equipment 1. Robot equipment 
1 is performing study of external force using the pulse signal of such PWM. The 
detection means 153 is specifically detected as a condition of the joint section 

152 that external force is acting the value of such pulse width of PWM through 
the right-hand-side material 151. in addition, as mentioned above, since the 
value of the width of face of the pulse signal of PWM is calculated as an error 
value (difference) of the target include angle of each joint (motor), and an actual 
include angle, the condition of the joint section 152 which the detection means 

153 detects is the error value of the target include angle of each joint (motor), 
and an actual include angle ~ it can also say. In addition, it realizes as one 
function of a digital disposal circuit 14 shown in drawing 8 etc., or the detection 



means 153 is realized by software or the object program. 

[0224] Here, with the gestalt of operation, although explained in full detail later, 
the pulse signal of PWM given to the leg units 3A, SB, and 3C and the motor 
used as the joint of 3D as a pulse signal of PWM for study of external force and 
the pulse signal of PWM given to the motor used as the joint of the idiosoma unit 
2 and the head unit 4 are used. Drawing 19 mentioned above - drawing 25 show 
change of the pulse signal of PWM of each joint section (motor) used for study of 
such external force when various external force is added, and show the pattern 
change according to various external force. In addition, the value of PWM pulse 
width serves as a candidate for abbreviation about 0 (x axis) so that it may 
understand, even if it compares the pattern in the case of "pushing back" in 
which it is shown in the pattern and drawing 21 in the case of "pushing on the 
front" in which it is shown in drawing 20 . 

[0225] In study of external force, study which used the neural network in the 
study means 160 is performed as data for study using such a pattern at the time 
of various external force which was mentioned above adding (in detail vector 
value). For example, the study means 160 is realized by software or the object 
program. 

[0226] As a neural network, it is learning using the neural network especially by 
back propagation of a hierarchy joint mold network. The neural network by back 



propagation has the high adaptability to pattern recognition, and with the gestalt 
of operation, as shown in drawing 29 and drawing 30 , he is performing study by 
the input layer 161 and the neural network by the three-layer back propagation 
which hides and consists of three layers of a layer (middle class) 162 and the 
output layer 163. 

[0227] If the information (value of pulse width) Din from a sensor is inputted into 
the input layer 161 after study by the neural network by such three-layer back 
propagation, the information Dout on the class of learned external force that it 
corresponds to Information Din from [ from the output layer 163 ] such a sensor 
will come to be outputted. 

[0228] the input layer 161 in the neural network by such three-layer back 
propagation - it hides and the layer 162 and the output layer 163 are specifically 
constituted as follows. 

[0229] The input layer 161 has two or more neurone, and has 18 neurone with 
the gestalt of operation. That is, the data of 18 are inputted into the input layer 
161 for study of external force, for example, robot equipment 1 - as a current 
posture ~ "~ standing ~ posture (Standing)" - Those with three kind, such as "a 
stability posture (a stability posture, Sitting)" and "recumbent form vigor 
(Sleeping)", Those with 15 kind (there are three kinds of 4 piece x3=12 kind and 
heads, and they are a total of 15 kinds), and since it is such, let 18 kinds of the 



grand total be input data for the value of the PWM pulse width of each joint 
(motor of each joint section). 

[0230] Here, the input of a current posture is also used for study of external force 

because the condition of joint Qoint) is dependent on a posture, namely, it is 

because the value of the pulse width is dependent on a posture. 

[0231] The pattern made into the vector value which consists of a value of each 

pulse width is inputted into such an input layer 161 as information Din from a 

sensor. In addition, with the gestalt of operation, the value of the pulse width 

which is an input value is normalized by (7) types in order to take a value within 

the limits of [-512,512]. 

[0232] 

[Equation 7] 

lmput= p^^^r'l "' 

[0233] P is the value of the surveyed pulse width here, Pmax is maximum (512), 
and Pmin is the minimum value (-512). Moreover, the normalization of the input 
data about a posture is unnecessary because of [0, 1] (in order to take one of the 
values of 0 or 1). 

[0234] It hides, and the layer 162 has two or more neurone, and has 17 neurone 
with the gestalt of operation. The number of these neurone is determined by the 



so-called TAMBU method. That is. it determined by taking an average with the 
number of the neurone of the input layer 161, and the number of the neurone of 
the output layer 163, and performing smoothing of the acquired value. It is based 
on the TAMBU method and hides, and if the number numOfHIdden of neurone of 
a layer 162 is expressed with a formula, it will become like (8) types. 
[0235] 
[Equation 8] 

numOfHidden- ^^"^^^-^^^P^^"^ immO f 0 u t p u t 
num 1 en-- ^ 

= 14+a 



[0236] Here, numOflnput is the number of neurone of the input layer 161, 
numOfOutput is the number of neurone of the output layer 153, and alpha 
becomes the value fluctuated by smoothing. If 10 is substituted for this (8) type 
as the number numOflnput of neurone of the input layer 161 as the number 
numOfOutput of neurone of 18 and the below-mentioned output layer 153, it will 
hide and the number numOfHidden of neurone of a layer 162 will be set to 17. 



[0237] The output layer 163 has two or more neurone, and has ten neurone with 
the gestalt of operation. Although there is the number of neurone of the output 
layer 163 with ten pieces here It suggests that this can recognize ten kinds of 
external force by study. For example, were pushed before (external force shown 
In ForceForward and drawing 20 ). Were pushed back (external force shown in 
ForceBakward and drawing 21 ). The right hand was held (external force shown 
in RightHandUp and drawing 24 ). The both hands by which the left hand was 
held (external force shown in LeftHandUp and drawing 25 ) were held (it 
BothHandUp(s)). Pushed having no illustration and the head upwards (external 
force shown in HeadUp and drawing 22 ). The head pushed down in the head 
(external force shown in HeadDown and drawing 23 ) was pushed on the right (it 
HeadRight(s)). It is pushed [ which was pushed on the left in having no 
illustration and the head (with HeadLeft and no illustration) ], and ten kinds of 
external force can be recognized as there being nothing (condition shown in 
NoForce, for example, drawing 9 ) etc. 

[0238] Thus, although many things are mentioned about the input layer 161 and 
the I/O function which hides, the layer 162 and the output layer 163 are 
constituted, hides, and is used in a layer 162 and the output layer 163, the 
so-called sigmoid function is used with the gestalt of operation. The sigmoid 
function has the property that an output changes smoothly to the input sum 



unlike the so-called threshold function etc., as shown in drawing 31 . 

[0239] The neural network by such three-layer back propagation is used, and 

study of various external force is made as follows. 

[0240] Study is performed by giving the pair of input vector data and instruction 
signal vector data to a network (study means 160), as shown in drawing 30 . The 
output of a certain specific neurone is 1 , and except it, teacher vector data is 
given so that it may be set to 0. That is, for example, all the classes of external 
force which does not need to be recognized are given as 0, using external force 
of a class to make it recognize as 1 . 

[0241] sigmoid function sigmoidQ as the output yj (1) from which an interlayer 
162 is obtained by the input sum indicated to be to (9) types at this time - 
sigmoid function sigmoid() as the output yj (2) from which it is therefore obtained 
and the output layer 163 is obtained by the input sum indicated to be to (10) 
types ~ therefore, it is obtained. And renewal of weight, i.e., study of weight, is 
made by (11) types. Here, sigmoid function sigmoid() is a function shown like 
(12) types. 



[0242] 



[Equation 9] 




• • • (9) 



[0243] 

[Equation 10] 

y.(^) =sigmoid ^--^^yC^) yO)^ . . . (lo) 



[0244] 

[Equation 11] 

W..^"-"" (t) =W..<'"-''>(t-l) -ey/"'^(t) Z .f"**^ 
+ 0Wy<"'+'>(t-l) (in=0.1) 



[0245] 

[Equation 12] 

Sigmoid (x) = 1 / ^1 + exp (- 



(12) 



[0246] ai is the value of each pulse width inputted here, zi is an error back 
propagation output, epsilon Is a learning function, and beta is a moment 
coefficient. In the case of the robot equipment 1 which is the factor which 
influences a study rate greatly, for example, was constituted like the gestalt of 
operation, epsilon (learning function) and beta (moment coefficient) can make a 
study rate the optimal by being referred to as epsilon= 0.2 and beta= 0.4. 
[0247] And the input of the input vector data of multiple times and the input of 



teacher vector data are performed, and study is ended when it converges below 
on a threshold with the error of the input vector data and teacher vector data 
which were inputted into the neural network. For example, study is ended when 
it converges below on a threshold with the 2nd [ an average of ] power error error 
as shown in (13) types. 
[0248] 

[Equation 13] 

error - ,jun,ofOutput 

• • • (13) 

[0249] Here, a is input vector data and te is teacher vector data. 
[0250] For example, a study procedure is online study (it learns serially), repeats 
the same data 10 times and learns them. Moreover, the data of the same pattern 
are also made to learn by 20 abbreviation continuation. By this, study by grand 
total abbreviation 800 sample will be made. 

[0251] An example of the relation between the count of study and a 2nd [ an 
average of ] power error is shown in drawing 32 . In the result shown in this 
drawing 32 , the 2nd [ an average of ] power error with the above-mentioned 
count of study is the minimum by about 50 times, and this shows that it is being 
completed by study by about 50 times. In addition, since the initial value of a 



weighting factor is given at random, with the initial value, extent of convergence 
of study usually changes. That is, although it may be completed by study by 
about 50 times in this way depending on initial value, I hear that it may require 
about 150 times, and it is until it completes study depending on the case. 
[0252] The study which used the neural network by three-layer back propagation 
with the above procedures is made. Thereby, by the input (input of multiple 
times) of two or more kinds of external force, robot equipment 1 can be made to 
be able to respond to the condition (for example, value of PWM pulse width) of 
the joint section 152, can learn two or more kinds of external force concerned, 
and can carry out KATEGORAIZESHON (classification-izing) of the external 
force, in addition for example, a ****** [ KATEGORAIZESHON well ] - or it can 
check whether fault study is carried out by performing the so-called 
generalization nature test by robot equipment 1 . 

[0253] By study of such external force, specifically robot equipment 1 It 
recognizes that the external force concerned is acting on the waist from two or 
more kinds of learned external force when external force is given to the waist. 
The stability as predetermined actuation which recognizes and corresponds that 
the external force concerned is acting on the waist from the value (pattern) of 
each PWM pulse width specifically given to each joint section 152 can be 
appeared now. Thus, robot equipment 1 can learn the external force of 



arbitration, thereby, can make high the degree of freedom of the interaction by 
the contact (external force) from a user, and can make many actuation appear 
now. 

[0254] In addition, although here explained the case where study in the study 
section was performed using the neural network by three-layer back propagation, 
it cannot be overemphasized in the study section that other learning technique 
can be used. For example, also KATEGORAIZESHON [ external force ] using 
SVM (Support Vector Machine). Although it is the approach of carrying out a 
linearity classification like a perceptron, SVM maps data once to nonlinear space, 
and since it asks for the hyperplane separated in the space, it can solve a 
problem nonlinear as a matter of fact. The formula showing the principle below is 
shown. 

[0255] Usually, the problem of pattern recognition can ask for recognition 
function f (x) shown in (14) types from the case where it considers as test sample 
x= (x1, x2, x3, ..... xn). 
[0256] 

[Equation 14] 



[0257] What is necessary is here, just to consider the problem which minimizes 



||v||2 under a constraint like (15) types, if a teaclier label is made into y= (y1, y2, 

y3. .... yn). 

[0258] 

[Equation 15] 

• • • (15) 

[0259] The problem which such constraint attached can be solved using 
Lagrange's method of undetermined multipliers. If the Lagrange multiplier is 
introduced, it can be shown like (16) types. 
[0260] 

[Equation 16] 




[0261] Here, if it ****** like [ v / b and ] (17) types, a secondary plan problem as 
shown in (18) types can be dropped. (19) The constraint is shown in the formula. 
[0262] 

[Equation 17] 



[0263] 



[Equation 18] 

max2a.-4-2a. a. y. y.xTx. * ' ' (^3) 



[0264] 

[Equation 19] 

S|J^5i#:a,s:0,2ci.y, = 0 ...(19) 



[0265] When there are few nunnber of dimensions of a feature space than the 
number of training samples, a slack variable xi>=0 is introduced and a constraint 
is changed like (20) types. 
[0266] 

[Equation 20] 

[0267] The performance index of (21) types is optimized about optimization. 
[0268] 

[Equation 21] 

i|vr + cx^ . . . (21) 

[0269] Here, C is the multiplier which specifies how far a constraint is loosened, 



and needs to determine a value experimentally. The problem about the 
Lagrange multiplier alpha is changed so that it may be shown like (22) types. 
(23) The constraint is shown in the formula. 
[0270] 

[Equation 22] 

max £ a. - ^ ot. a. y . xT x. 

^ • - (22) 

[0271] 

[Equation 23] 

$JW*ft:0sa,^C,2«^y, = 0 

• • • (23) 

[0272] However, so far then, since a nonlinear problem cannot be solved, it 
considers introducing the kernel function K (x x') which is a nonlinear mapping 
function, mapping to the space of high order origin once, and carrying out 
linearity separation in the space. By carrying out like this, it becomes carrying out 
nonlinear separation and an EQC at the original dimension. A kernel function 
can be shown like (24) types using a certain map phi. And a discriminant 
function comes to be shown in (25) types. 
[0273] 

[Equation 24] 



K(x.x') = «1>(x)^*(x') 



(24) 



[0274] 



[Equation 25] 



f (x)] = * (x) + b 



= 2:a.y.K(x,x,) + b 

• • • (25; 

[0275] Study comes to be shown in (26) types. (27) The constraint is shown in 

the formula. 

[0276] 

[Equation 26] 



[0278] (28) types of a Gaussian kernel etc. can be used as a kernel function. 
[0279] 

[Equation 28] 



maxZa,-j2:aja.y.y.K(x,,x.) 



• • • (26) 



[0277] 



[Equation 27] 



SIWSfctt:0*a,sC,2a,y, = 0 



• • • (27) 




• • • (28) 



[0280] By the above principles, KATEGORAIZESHON of action by SVM 
becomes possible. 

[0281] Moreover, although here explained the case where robot equipment 1 
learned external force based on the condition of joint (joint section), it is also 
good to stop at detecting the external force which acts on robot equipment 1 
from the condition of joint. That is, robot equipment 1 is equipped with a 
detection means to detect the condition of the joint section for operating 
right-hand-side material, and an external force detection means to detect the 
external force which acts on right-hand-side material based on the condition of 
the joint section which the detection means detected, in this case. For example, 
a detection means here is the detection means 153 shown in above-mentioned 
drawing 28 . 

[0282] It is detectable that such robot equipment 1 had external force based on 
the condition of the joint section. And it can detect that external force is added, 
without being able to realize a detection means and an external force detection 
means as software or an object program, and, for example, such robot 
equipment 1 equipping a sensor specially (dedication) therefore. Moreover, it 
can be said that study of external force is attained, without having a new 
configuration, even if it faces robot equipment 1, when learning external force 



which was mentioned above. 

[0283] In addition, the configuration which detects such external force in robot 
equipment 1 is a configuration as the so-called external force detection 
equipment, and it cannot be overemphasized that it is not limited to the 
configuration as this external force detection equipment being adapted for robot 
equipment 1. 

[0284] Moreover, the pulse signal of PWM given to the leg units 3A, 3B, and 3C 
and the motor used as the joint of 3D as a pulse signal of PWM for study of 
external force in this example, Although the case where the pulse signal of PWM 
given to the motor used as the joint of the idiosoma unit 2 and the head unit 4 
was used was explained, it is not limited to this and the pulse signal of PWM of 
the motor which constitutes other joints can also be used for study of external 
force. 

[0285] Moreover, although this example explained the case where the pulse 
signal of PWM was being used for study of external force, it is not limited to this 
and the signal which changes according to external force can be used for study 
of external force. 
[0286] 

(4-4) Recognition of a sound signal (example of the speech recognition section) 
Next, recognition of a sound signal is explained concretely. Robot equipment 1 is 



J: 

i 

equipped with the sound signal input section 121, the characteristic quantity 
extract section 122, and the HMM section 123 as a part which recognizes a 
sound signal, as shown in drawing 33 . Here, the configuration which consists of 
the characteristic quantity extract section 122 and the HMM section 123 serves 
as an example of the speech recognition section 101 shown in drawing 15 . 
[0287] The acoustic signal input section 121 is a part into which a surrounding 
sound etc. is inputted. For example, it is the above-mentioned microphone 23. 
The acoustic signal (sound signal) from this acoustic signal input section 121 is 
outputted to the characteristic quantity extract section 122. 
[0288] The characteristic quantity extract section 122 detects the characteristic 
quantity of an acoustic signal, and outputs it to the latter HMM section 123. 
[0289] Hidden Markov Model is used for the HMM section 123, and it carries out 
the class classification of the inputted acoustic signal based on characteristic 
quantity. For example, an acoustic signal is identified based on the class 
classified into plurality. And the HMM section 123 outputs the recognition result 
in each class as a probability to seem the word corresponding to for example, 
each class. For example, it outputs as a vector value. 

[0290] By the above configurations, robot equipment 1 identifies the voice 

inputted from microphone 23 grade as a phoneme sequence. 

[0291] And as shown in drawing 34 , the information on the language recognized 



by the speech recognition section 101 by HMM [SO, SI, S2] is inputted into the 
associative remembrance storage section 104 with the information on the 
actuation acquired by the sensor recognition section 102 [VO, VI, V2, V3, V4]. 
[0292] In the associative remembrance storage section 104, such information is 
tied up and memorized at the time of study. And the associative remembrance 
storage section 104 outputs action information after study based on the inputted 
information. For example, the action information on a vector value [BO, B1, B-2, 
B3] is outputted. 

[0293] As shown in drawing 35 , in study For example, the language of "the 
stability (backward)" as a speech recognition result, as the result depended on 
acquisition of action - vector [- 0. — when 1, 0.9, 0.2, 0.1, and 0.3] are inputted 
and "stability (backward)" is inputted after study, actuation [0, 1, 0, 0, 0] of 
"stability" is outputted as action information. 

[0294] In the above, study by the associative remembrance in robot equipment 1 
was explained. Next, the study which took in the joint cautions which make 
specification of a study object easy is explained. 

[0295] (5) When you learn the voice and the image by joint cautions robot 
equipment 1, let it be a premise to specify a specific sound and a specific image 
from a surrounding noise, and to set this as the object (a study object, target 
object) of study. Joint cautions make specification easy for such a study object. 



For example, or joint cautions shake a study object, it shakes (visual stimulus) or 
they become possible by generating a stimulus for the informer-ed 
(acoustic-sense stimulus) of uttering and directing voice making a study object 
specify. 

[0296] As a configuration for joint cautions, robot equipment 1 is equipped with 
the picture signal input section 131, the segmentation processing section 132, 
and the study object detecting element 133, as shown in drawing 36 . The 
segmentation processing section 132 and the study object detecting element 
133 function as a study object specification means to specify a study object here. 
And it functions as a behavior control means by which the above-mentioned 
action generation section 105 acts based on the information on the study object 
concerned of the associative remembrance storage section 104 the information 
on the study object which such a study object specification means specified was 
remembered to be, and the information on the detected new object. 
[0297] The picture signal input section 131 is a part which picturizes a perimeter, 
and, specifically, is CCD camera 20 shown in drawing 8 . The picture signal 
inputted from this picture signal input section 131 is inputted into the 
segmentation processing section 132. 

[0298] The segmentation processing section 132 performs segmentation from a 
picture signal. For example, the segmentation by the color is performed. 



Segmentation pinpoints a field in an image and means investigating or mapping 
****** of that in a feature space. By this segmentation, differentiation with a study 
object and a surrounding image is attained in the picturized image. The picture 
signal by which segmentation was carried out in the segmentation processing 
section 132 is inputted into the latter study object detecting element 133. 
[0299] The study object detecting element 133 detects a cautions part (study 
object) from the image information by which segmentation was carried out 
(specification). For example, by making into a specific region a part with the 
image information lost motion by which segmentation was carried out, i.e., the 
part which is changeful in time sequence, when some conditions are fulfilled, it 
detects as a study object. Specifically, detection of a study object is made as 
follows. 

[0300] First, in the image by which segmentation was carried out, the amount of 
cautions is set up by making into a specific region a part (part which is changing 
in time) with a motion. Here, the amount of cautions serves as an index for study 
object specification. In specifying a study object by motion, the amount of 
cautions turns into an amount which changes with motions. 
[0301] And the specific region is followed and it distinguishes whether it is a 
study object with the amount of cautions, if conditions with the amount of 
cautions are fulfilled, specification 1, i.e., robot equipment, "will pay attention" as 



a study object — it is made like. 

[0302] Although that is right about specifying a study object by motion also in the 
human world, an informer is because the study object concerned is shaken, or it 
shakes and it teaches an informer-ed, in case a study object is taught, for 
example, in case it teaches that it is a "cop", an informer comes out so that a 
"cop" may be said to an informer-ed as a "cop" with a swing and may be taught. 
[0303] When a specific region is followed and a value predetermined in the 
amount of cautions, for example, a motion, shows change of the specified 
quantity, the study object detecting element 133 is specified as a study object, 
and pays attention. Attention is paid when beyond a threshold (step) with the 
amount of cautions is specifically exceeded. 

[0304] Thus, by the segmentation processing section 132, the study object 
detecting element 133 set the amount of cautions as the specific region, and has 
detected the study object (specification). 

[0305] Robot equipment 1 is enabling joint cautions by having the above picture 
signal input sections 131, the segmentation processing section 132, and the 
study object detecting element 133. 

[0306] Thereby, robot equipment 1 can make suitable study connected to image 
information or action, as a study object is specified appropriately and mentioned 
above. 



[0307] In addition, the gestalt of above-mentioned operation explained 
specifying as a study object from a motion of an object (body) about the joint 
cautions which robot equipment 1 performs. However, it is not limited to this. For 
example, a study object can also be specified with voice. In this case, robot 
equipment 1 specifies an object as a study object toward the direction where 
voice is uttered. For example, when the amount of cautions is set up to voice, for 
example, the generated direction, and magnitude and some conditions are 
fulfilled, it is made to specify as a study object. 

[0308] Moreover, the cautions over a study object are good also as what shall be 
decreased by time amount. Or it is good also as what will be decreased if 
association is stabilized. Attention can be paid to a new stimulus (an image input, 
voice input) by this, and study can be ignited (initiation). 

[0309] Moreover, when attention is paid, it is good on a step also as taking a big 
value and making it decrease according to some conditions. For example, it is 
made to decrease by the passage of time by making some conditions into time 
amount. Moreover, by one side, the amount of cautions can also be set as 
coincidence to two or more objects. For example, a setup of the amount of 
cautions is performed to a motion of an object or voice. For example, it carries 
out to a motion of one object, the amount of cautions is set up, and the amount 
of cautions is set up to voice about the object of another side. 



[0310] While this is investigating the object (specific region) which has paid 
attention (characteristic quantity, such as a color and a form, is investigated), the 
amount of cautions can be set as other objects by other stimuli (for example, 
voice, an image). Here, about the object which has paid the present attention, 
since it considers as the big value on a step as mentioned above, even if the 
amount of cautions is set as the object which is different with such other stimuli, 
investigation of the object chosen previously for a while can be continued. 
[0311] And when "cautions" of the object which has paid the present attention 
have declined, cautions can be turned to an object with other stimuli, i.e., the 
object which the amount of cautions has increased. 

[0312] Moreover, although joint cautions are based on a motion of a study object 
as a stimulus, human being's finger can also perform them to others. That is, the 
body of the direction which the finger points out is specified as a study object. 
[0313] Such joint cautions are the examples of the joint cautions assumed by the 
interaction of the usual man and a man. For example, attention is paid in this 
case by making into a specific region the beige field obtained by segmentation. It 
explains using drawing 37 . 

[0314] As shown in (A) among drawing 37 , suppose that the image pick-up 
image which is pointing to the cone 141 by the hand 142 was obtained in a 
certain environment. In addition, in the following processings, a low pass filter 



may be covered over an image pick-up image for an object in consideration of 
calculation speed etc. by the image processing. 

[0315] And the beige part in an image is sampled. In this case, a color feature 
space is used, the description of a beige part is acquired, and the beige part in 
an image is sampled. Thereby, as shown in (B) among drawing 37 , the part of a 
hand 142 is sampled. 

[0316] And as shown in (C) among drawing 37 , the longitudinal direction of the 
part of the hand 142 is specified. This is because the configuration of the hand 
when pointing to an object becomes abbreviation rectangle-like toward an object. 
For example, a longitudinal direction is specified as shown in the line 143 in 
drawing. 

[0317] And as shown in (D) among drawing 37 , the longitudinal direction for 
which the subject-copy image was asked is doubled, and an object is specified 
as shown in (E) among drawing 37 . That is. the cone 141 to which it points with 
the finger is specified. For example, the image near the tip of a finger is taken out 
as a sample, a color is specified in a color feature space and the field constituted 
by the corresponding color is pinpointed. It considers as the same color by this, 
for example, the yellow cone 141 can be specified. 

[0318] Moreover, about joint cautions, it is not limited to what is depended on the 
above technique. For example, it can also consider as joint cautions of paying 



attention to the thing of the point human being's look. 

[0319] Moreover, robot equipment 1 may be equipped with a means to check 
whether joint cautions are performed. That is, predetermined action is made to 
appear when the candidate for study is specified by joint cautions. For example, 
when an object is shaken, instruction is made and the candidate for study is 
specified (tailing), robot equipment 1 makes action of shaking a head appear, 
and tells a user about the specified purport. Thereby, an instruction object can 
check whether robot equipment 1 has caught the object which self is teaching as 
a study object. 

[0320] As mentioned above, through human being and interaction, self can 
evaluate action and robot equipment 1 can gain suitable action for self. 
[0321] Moreover, by carrying out associative storage of the action to other audio 
sensor stimuli, robot equipment 1 can be learned so that the action can be taken 
out only with voice. 

[0322] Next, the example of the associative storage system mentioned above is 
explained, referring to drawing 38 . It sets in the example of the associative 
storage system shown in this drawing 38 , and what is memorized and reminded 
of four consciousness channel input configurations (a color, a form, voice, 
instinct) is assumed. In this drawing 38 , the input of each channel of the color 
(Color) recognition machine 201, the form (Shape) recognition machine 202, and 



the voice (Speech) recognition machine 203 is received. Prepare some patterns 
or prototypes beforehand and binary ID (identification information) is attached for 
every prototype. It recognizes whether with each recognition vessels 201-203, 
an input configuration corresponds to which these prototypes. He outputs the ID 
ID, i.e., a color prototype, the form prototype ID, and the voice prototype ID, 
respectively, and is trying to send them to the short-term memory section 211 of 
the associative storage section 210. Here, through the semantics converter (SC) 
204 which performs the tagging to which the output from the voice (Speech) 
recognition machine 203 followed semantics and syntax, the voice prototype ID 
is sent to the short-term memory section 211, and a phoneme symbol string 
(Phoneme Sequence) is also sent to coincidence at the short-term memory 
section 211. Moreover, about instinct, from the instinct information bureau 
(ISM:lnternal StatesModel) 205, the change value (delta value) of instinct (for 
example, curiosity) is outputted as an analog quantity, and is sent to the 
short-term memory section 21 1 of the associative storage section 210. 
[0323] The associative storage section (Associative Memory) 210 has the 
short-term memory section (Short Term Memory) 211, the long-term memory 
section (Long Term Memory) 212, and the cautions storage section 
(AttentionMemory) 213, and is constituted. Furthermore, in this associative 
storage system, the release mechanism (RM) 221 and the action (behavior) 



network (BeNet) 222 are formed in relation to the short-term memory section 
211. RM (release mechanism)221 and BeNet (action network)222 are also 
called the action generation section. 

[0324] In the associative storage system shown in this drawing 38 , with the color 
recognition vessel 201, the color prototype ID is added to each object by which 
segmentation was carried out with the color segmentation module, and it is 
inputted into the associative storage section 210. From the speech recognition 
machine 203, the prototype ID of a word is outputted by a user's utterance and 
the phoneme symbol string (Phoneme Sequence) of utterance is also sent to the 
associative storage section 210 at this time. By this, it becomes possible by 
processing of storage and association to make a robot speak. The information 
on each inputted channel is stored in the short-term memory section 21 1 in the 
associative storage section 210 (Short Term Memory), and part extent 
preservation for a certain fixed time amount, for example, 100 objects, is carried 
out. 

[0325] The associative storage section 210 is associated with whether it 
memorized in the past about an input configuration (recall). When it cannot 
associate, an input configuration is transmitted to the release mechanism (RM) 
221 and the action network (BeNet) 222 as it is. When it can associate, the 
direction of association is added and it transmits to RM221 and BeNet222. 



[0326] At BeNet222, it is a flag (Shared Attention Flag) from the color 
segmentation module of the color recognition machine 201 . The existence of the 
joint cautions by pointing from a user which was checked and mentioned above 
is changed into a latch command, and it transmits to the associative storage 
section 210. In the associative storage section 210, if a latch command is 
received from BeNet222, retrieval by the frame number is performed and the 
object which matches is stored in the cautions storage section (Attention 
Memory) 213. In this condition, if the change value (delta value) of instinct is 
large enough, the storage (memory) to the 213 long-term memory sections 
(Long Term Memory) 212 from the cautions storage section (Attention Memory) 
will be performed. If the change value (delta value) of instinct can take an 
analog-value like 0-100 and the delta value of instinct is memorized by 80, it can 
acquire the value 80, by association. 

[0327] Next, the detail of associative storage is explained. Drawing 39 shows a 
two-layer hierarchical neural network's example used for associative storage. In 
this drawing 39 , the example of the competitive learning network which uses the 
first pass as the input layer (Input Layer) 231, and uses the second layer as the 
contention layer (Competitive Layer) 232 is shown, and joint weight between the 
i-th unit (neurone) of the input layer 231 and the j-th unit of the contention layer 
232 is set to Wji. As actuation, a storage mode and the 2 modes of associative 



(or remembrance) modes exist, an input configuration is memorized 
competitively and the pattern memorized in the past is recollected in 
remembrance mode from a certain partial input configuration at a storage mode. 
In an input side, they are the input x1 of the above-mentioned color, a form, 
voice, and instinct, x2, xm. When correspond, and m neurone exists, for 
example, it makes the color prototype ID, the form prototype ID, and the voice 
prototype ID into 20 pieces at a time, respectively and the class of instinct is 
made into six pieces, the number of input neurone becomes 66 pieces from 
20+20+20+6=66. Each neurone expresses one symbol and, as for contention 
neurone, the number of contention neurone is equal to the number of a 
memorizable symbol or patterns. By the above-mentioned example, although 
each prototype ID and all the combination patterns of the class of instinct are set 
to 48000 by 20x20x20x6, mounting about 300. for example is mentioned. 
[0328] Next, a storage mode is explained. The joint weight Wji of the input layer 
231 and the contention layer 232 shall take the value of a before [ from 0 / 1 ]. 
Early binding weight is determined at random. Storage chooses the neurone in 
which it won straight victories in the contention layer first, and is performed by 
strengthening the bonding strength (joint weight Wji) of the neurone and input 
neurone. Input pattern vector [x1, x2, xn] If attached, when the prototype ID 
corresponding to neurone x1 (for example, the 1st color prototype ID) has been 



recognized, for example, it is the neurone x1 concerned. It carries out to making 
it Ignite and igniting the neurone a form and voice have been similarly 
recognized to be one by one. The neurone which ignited takes +1 and the 
neurone not Igniting takes the value of -1. 

[0329] output (contention) neurone yj a value - neurone x1 of an input side 

******** - it asks by the following (29) types. 

[0330] 

[Equation 29] 

numOflnput 

= Wo • • • (29) 



[0331] Moreover, the neurone which wins straight victories in contention is max 

{yj}- 

It is alike and asks more. 

[0332] Neurone which won straight victories in contention (winner neuron) The 
renewal of association with input neurone is Kohonen. By the updating 
regulation, it is deltaWji =. alpha (x1-Wji) alpha: Rate Wji(new) of study = It asks 
by deltaWji^Wji (old). This is normalized by L2Norm and it considers as the 
following (30) types. 
[0333] 

[Equation 30] 



[0334] This bonding strength expresses the so-called strength of study, and 
turns into mneme. 

[0335] Here, as an example, the above-mentioned rate alpha= 0.5 of study is 
used, if it is made to memorize once, it will not forget, and if the pattern same 
next time is shown, it can be reminded of the pattern memorized almost rightly. 
[0336] In addition, originally, it is the process which the target is made to learn 
serially, and it is also possible for mneme to become strong about a pattern with 
many counts of presentation, and for structure of mneme which becomes weak 
to be searched for from associative storage from the pattern seldom shown, and 
to apply to the gestalt of this operation. That is, if it can respond by tuning of the 
rate of study, and associative storage, for example, the rate of study is set up 
low, by the time mneme becomes strong so much, the count of presentation will 
be needed. Moreover, according to the count of presentation, the rate of study 
was made low, for example, although 1 time of the beginning had the high rate of 
study, it was also able to be said that the rate of study was made low, so that the 
count of presentation increases. It arises that it can be reminded of the pattern 
which renewal of mneme is seldom performed about a pattern with few counts of 



presentation by this, consequently storage becomes ambiguous, and is different 
from having memorized, and cannot reach and associate to an associative 
threshold. However, since thepart, a new symbol, or a pattern may be able to be 
gained, even if capacity is restricted, a flexible associative storage system can 
be realized. 

[0337] Next, remembrance (association) mode is explained. A certain now and 
input pattern vector [x1, x2, xn] Suppose that it was shown to this associative 
storage system. The likelihood and the probability as opposed to Prototype ID 
also in Prototype ID are sufficient as this input vector, output (contention) 
neurone yj a value - neurone x1 of an input side ******** - although calculated 
by the above-mentioned (29) formula, according to the likelihood of each 
channel, the ignition value of contention neurone also expresses a kind of 
likelihood. The point that it can act as the connection of them and can ask for 
overall likelihood from the likelihood input from two or more channels is 
important here. That with which the example of the gestalt of this operation is 
associated is max {yj} about the neurone which is only and wins straight victories 
in contention. 

It is alike and asks more. The number of the neurone for which it asked is 
equivalent to the number of a symbol, and recollects an input configuration by 
the inverse-matrix operation. That is, they are Y=W-XX=W-1 and Y=WT-Y. 



[0338] Next, the count of presentation and coupling coefficient of an input 
configuration are explained. By the exannple of the gestalt of this operation, the 
rate of study is set up highly, and it tunes up so that the shown pattern nnay be 
memorized by once. The relation between the count of study in this case and a 
coupling coefficient is investigated. The coupling coefficient of a certain input 
configuration and symbol neurone of a contention layer is equivalent to 
investigating the above-mentioned (29) formula. 

[0339] Here, drawing 40 expresses the count (epoch) of presentation, and the 
axis of ordinate for the axis of abscissa as a neurone ignition value (activation) 
about the relation (non-active input) of association to the input neurone in which 
association with the neurone which ignited by a certain input configuration, and 
the neurone of a contention layer which gained the symbol is not related (active 
input), and has not ignited, and the neurone of a binder course. In active input, 
this drawing 40 shows that association with an input configuration and symbol 
neurone has become strong, so that the count of presentation increases. 
Association has become strong rapidly by the 2nd presentation because it was 
greatly updated by the 1st presentation, and if the rate of study is set up low, it 
will become a loose curve. In contrast with this, association with the neurone 
which has not ignited in the input configuration in non-active input has become 
weaker. 



[0340] In addition, building the associative storage system not only in 
consideration of the count of presentation but presentation frequency is also 
mentioned. This is because it is desirable to memorize preferentially the pattern 
shown well from storage capacity being immobilization (finite). It is desirable to 
also introduce an oblivion function in relation to this. For example, it is more 
desirable to rnemorize the important pattern which did not need to save once the 
pattern memorized by mistake with nonlinear elements, such as a noise of a 
recognition machine, only by presentation, and there were few counts of 
presentation, and it is made to forget about a pattern also with low presentation 
frequency moreover, and was shown newly. 

[0341] Although the rate of study is fixed and new discernment of being an input 

configuration is performed in the example of the gestalt of this operation here 

using a certain threshold, it is also possible to change the rate of study, and 

formulization is also possible about how to decide a threshold. 

[0342] Next, the response to many input configurations is explained. The result 

of having tested about actuation of the associative storage system when 

showing various patterns as an input is shown in the next table 1. 

[0343] 

[Table 1] 
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[0344] In this table 1, each prototype ID about a color (Color), a form (Shape), 
voice (Speech), and instinct (instinct) is expressed with figures, such as 1, 2, 
and and the prototype ID of which it was renninded is expressed with a figure 
with O. **, etc. 

[0345] Although 5th presentation will be associated with [1, 3, **, **] only based 
on a color 1 if the pattern of a color 1 and a form 3 is inputted after an input 
configuration [1, 1, 1, 1] is memorized first (memory) so that clearly from this 
table 2 (recall) 7th presentation after the pattern of [1 , 3, 3, 1] was memorized by 
the 6th following presentation is associated with [1 , 3, **, **] to the input of the 



pattern of a color 1 and a form 3 (recall). 

[0346] Here, although storage of the input configuration of 20 as shown in the 
next table 2 is normally performed when making memory capacity into 20 
symbols, what was later learned to presentation of many input configurations (a 
total of 400 patterns) will be held as storage from 20 as shown in the next table 3. 
and the symbol memorized in early stages as shown in [1, 1, 1, 1] will be 
ovenA^ritten. 
[0347] 



[Table 2] 
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[03481 



[Table 3] 
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[0349] It is the symbol which can be gained in the case of Table 3 (maintenance) 
from what was learned at the end to in front of 20 symbols. 
[0350] By the way, when "the time of the input configuration from which the 
ignition value of two or more neurone differs being shown" is adopted, for 
example a color differs from a form as decision conditions of whether to be a 
new symbol although the same identifier cannot be attached to two or more 
bodies with which a color differs from a form, it is possible to attach the same 
identifier. Namely, although [1. 1, 1. 1], and [2, 1, 1, 1] are not memorizable to 
coincidence. [1, 1, 1, 1], and [2, 2, 1, 1] can be memorized. In this case, all input 
configurations as shown in the next table 4 are memorizable. 
[0351] 
[Table 4] 
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[0352] In an associative storage system which was explained above, since 
storage capacity is restricted, it is necessary to use efficiently. For that purpose, 
it is desirable to memorize preferentially the pattern shown well or to memorize a 
pattern with high frequency preferentially. 

[0353] Moreover, when the pattern without the need of memorizing is forgotten in 
relation to storage capacity and an important new pattern is inputted, it is 
desirable to make storage possible. (For this reason, the following 
coupling-coefficient oblivion functions f, i.e., Wnew = f, (Wold)) 
******** — things are mentioned. In addition, Wnew A new coupling coefficient 
and Wold An old coupling coefficient is shown. The easiest oblivion function is 
the approach of weakening a coupling coefficient with defeat person neurone in 
a contention layer, whenever a pattern is shown. For example, new coupling 
coefficient Wnew Old coupling coefficient Wold Being referred to as Wnew = 
f(Wold) = Wold-Wforget using the oblivion coupling coefficient Wforget is 
mentioned. Thereby, association to the pattern which is not shown can become 



weaker and can forget a pattern with unimportant low frequency. Here, it is 
natural to set up the oblivion function f based on the knowledge of human 
being's cerebrophysiology in the case of a humanoid robot, and it is desirable. 
[0354] Moreover, although taken up about storage of a word (noun) by the 
example of the gestalt of operation mentioned above, it is desirable to take into 
consideration also about acquisition of semantic memory, episodic memory, and 
a verb. For example, it is gaining the action of "kicking" and enabling it to gain 
the word of "kicking" etc. 

[0355] Moreover, although a judgment of a new input configuration is made on 
the ignition value of the winner neurone of a contention layer by establishing a 
threshold, it is desirable for it to be necessary to retune up with the increment in 
an input channel, and to be able to set up quantitatively, for example, to make it 
calculate automatically in a program. 

[0356] Furthermore, when the number of input channels increases and it 
becomes multi-modal, it is desirable to take into consideration also about 
normalization of each channel. 

[0357] Next, in relation to the instinct information bureau (ISM:lnternal States 
Model) 205 of above-mentioned drawing 38 , the example of implementation of 
the action decision approach of robot equipment is explained. That is, the 
example of the operation test for investigating the generation of operation in the 



robot equipment which applied the ethology-approach which opts for the action 
to perform based on an external causative agent and an inner causative agent is 
explained. 

[0358] In the example of the gestalt of this operation, eight gages (gauge) and 
eight instinct (instinct) are used about a robot's internal state (Internal States) 
and instinct. As eight gages showing a robot's internal state, namely, 
Nourishment (nourishment), Movement (stools), Moisture (moisture). Urine 
(urine), These each is received using Tiredness (fatigue). Affection (love), 
Curiosity (interest), and Sleepy (sleepiness). Hunger (food intake avarice), 
Defecation (defecation avarice), Thirst (water intake avarice). Eight instinct 
(instinct) of Urination (urination avarice). Exercise (movement avarice), Affection 
(love avarice), Curiosity (curiosity), and Sleepy (sleep avarice) is made to 
correspond. 

[0359] In accordance with [ which is notified from biorhythm (Biorhythm) ] time 
amount, an internal state changes, and changes also with a success/failure in a 
sensor input and action. For change width of face, the degree of 0-100, and 
change is personality_gauge.cfg. And the multiplier in personality_perception.cfg 
determines. 

[0360] Moreover, for Frustration (frustration), desire is Maximum MAX. It is 
generated when action cannot be issued, even if it reaches, and it is a gage 



(gauge) by action. It has set up so that it may be cleared, when it changes as 
expected. 

[0361] Contents tree as shown in drawing 41 by which two or nnore actions were 
built in the layered structure (tree structure) as an action selection / decision 
system by ethology-approach in this operation test here (contents tree) It uses. 
By this contents tree, it considers as a system (system), a subsystem 
(subsystem), the mode (mode), and a module (module) from a high order at 
order, action of the upper layer is considered as abstract action like a wish, and it 
considers as concrete action for action of a lower layer to realize such a wish. By 
the tree of drawing 41 , minimum action was carried out as an ecological model 
(Ethological Model), and the thing in which a change to the tree which used 
speech recognition and a test of operation, and the test about study are possible 
is adopted. Moreover, in this operation test, the instinct corresponding to the tree 
of drawing 41 (instinct), i.e., Hunger, (food intake avarice), Affection (love 
avarice). Curiosity (curiosity), and Sleepy (sleep avarice) are used, and only the 
gage corresponding to such instinct (instinct) (gauge), i.e., Nourishment, 
(nourishment), Affection (love), Curiosity (interest), and Sleepy (sleepiness) are 
used. In addition, although it has described on a code what what is concretely 
considered as a success and is considered as failure and is considering as 
linearity correspondence about correspondence of a gage (gauge) and instinct 



(instinct) in the actual operation test when a module (module) is performed, it is 
not limited to this. 

[0362] the gestalt of this operation - setting - feeling (emotion) ******** the 
expression with two or more shafts — using — **** - concrete — vigilance 
(Activation) and the degree (Pleasantness) of ** - using -- further - already 
feeling is expressed to three-dimension space with three shafts using the 
reliability (Certainly) of one shaft. Vigilance (Activation) is a degree of whether it 
has occurred or to sleep determined by biorhythm which mainly exists in a living 
thing, the degree (Pleasantness) of ** is a degree instinct indicates it to be which 
was filled or whether it is filled, and reliability (Certainly) is a degree which shows 
whether it is that what is carrying out current attention can be sure that which is 
by itself. As an instinct required to ask for the degree (Pleasantness) of **, 
8gauge(s) and Sinstinct which were mentioned above are used (up to four gages 
which were corrected and were mentioned above in the operation test, and 4 
instinct). Time variation is carried out so that the value of -100-100 within the 
limits shall be respectively taken about vigilance (Activation), the degree 
(Pleasantness) of **, and reliability (Certainly) and 0 may always be held about 
the degree (Pleasantness) of **, and reliability (Certainly). Moreover, vigilance 
(Activation) also holds 0 and he is trying to use a value for it as it is about 
biorhythm (Biorhythm) in the case of an instinct (instinct) factor. 



[0363] The degree of satisfaction of instinct (instinct) is made to reflect in the 
degree (Pleasantness) of **. Reliability (Certainly) is a vision object (Vision 
Object), when there are some which are careful of (Attention). The reliability of 
the very thing to depend is used as it is. Although fundamentally based on the 
value of biorhythm (Biorhythm), when vigilance (Activation) has fluctuation in 
sleep (Sleep), it is changed using the result. 

[0364] Although biorhythm (Biorhythm) is made to reflect only in vigilance 
(Activation) and the reliability (Certainly) in this case is changed in 0-100 as a 
limitation in this operation test, of course, it is not limited to this. 
[0365] Next, the test result about eating with sleep (Sleep) (Eat) is explained as 
the 1st example of an operation test, referring to drawing 42 - drawing 44 . /to 
look for (Search) in this 1st operation test, consider instinct (instinct) other than 
Hunger (food intake avarice) and Sleepy (sleep avarice) as immobilization, and 
according to the module (module) of the contents tree of drawing 41 - eating 
(eat) — the change which sleeps (Sleeping) is investigated. Drawing 42 shows 
Hunger (food intake avarice) of the instinct (instinct), and time amount change of 
Sleepy (sleep avarice), drawing 43 shows time amount change of vigilance 
(Activation), the degree (Pleasantness) of **, and reliability (Certainly) as feeling 
(emotion), and drawing 44 shows the sleep (Sleep) as motivation (Motivation), 
and time amount change to eat (Eat). 



[0366] A change to the Sleep tree by PAT (it strokes) is possible, and although 
not illustrated, the change from the Sleep tree by HIT (it strikes) is also possible 
so that clearly from these drawing 42 - drawing 44 . A change to the Eat tree by 
Hunger (food intake avarice) increasing and the change to Sleep by Hunger 
being filled are also possible. When struck, since Sleep is min (MIN), -100 [ i.e., ], 
there is no change in vigilance (Activation), because instinct (instinct) is not 
changed. Since a frustrated (Frustration) (not shown) value increases after 
Hunger becomes max (MAX), 100 [ i.e., ], the increment in the degree 
(Pleasantness) of ** becomes somewhat loose. 

[0367] Next, a value change is indicated to be a change of the behavior 
(behavior) at the time of using the contents tree of drawing 41 for instinct 
(instinct) etc. to drawing 45 - drawing 47 as the 2nd example of an operation test 
using four instinct (instinct) corresponding to all the four above-mentioned gages 
(gauge) (nourishment), i.e.. Nourishment, Affection (love), Curiosity (interest), 
Sleepy (sleepiness), and these. Drawing 45 shows time amount change of 
instinct (instinct), drawing 46 shows time amount change of feeling (emotion), 
and drawing 47 shows time amount change of a release mechanism (Release 
Mechanism). 

[0368] In these drawing 45 - drawing 47 , the change to Sleep by PAT (it strokes), 
the change to Eat by Hunger (food intake avarice), and the change of the 



information acquisition (Information Acquisition) by Curiosity (curiosity) are 
operating effectively, respectively. Moreover, in the condition that actuation is 
not discovered although Curiosity (curiosity) of instinct (instinct) is max (100), it 
turns out that the degree (Pleasantness) of ** is swaying in the unpleasant 
direction (frustration), furthermore if Sleep increases by PAT (it strokes) the 
degree (Pleasantness) of ** — ****** — changing — it — following — peacefulness 
- asking (ComfortSeeking) - signs that it is changing are known. 
[0369] By the above operation test, it has checked that action selection / 
decision system by the ethology-approach based on the contents tree of drawing 
41 was operating effectively. 

[0370] In addition, this invention is not limited only to the gestalt of operation 
mentioned above, neither the concrete example of a configuration of an 
associative storage system nor the contents tree for an operation test is limited 
to the example of illustration, for example, various configurations are possible. In 
addition, of course, configurations various in the range which does not deviate 
from the summary of this invention are possible. 
[0371] 

[Effect of the Invention] The action which the robot equipment concerning this 
invention detected the information inputted before and after [ of the contact 
detection by the contact detection means ] time with the input detection means, 



and appeared according to the contact detection by the contact detection means, 
The input which the input detection nneans detected is tied up and it memorizes 
for a storage means. With a behavior control means Corresponding action can 
be made to appear again, when input and the action which appeared on that 
occasion are tied up and memorized and the same input is again inputted by 
being reminded of action from the information in a storage means, and carrying 
out the action based on the newly acquired input. 

[0372] Moreover, the behavior control approach of the robot equipment 
concerning this invention The contact detection process of detecting contact, 
and the input detection process of detecting the information inputted before and 
after [ of the contact detection by the contact detection process ] time. The 
storage process which connects the action which appeared according to the 
contact detection by the contact detection process, and the input detected at the 
input detection process, and is memorized for a storage means. Based on the 
newly acquired input, it is reminded of action from the information in a storage 
means, and has the behavior control process which carries out the action. 
[0373] The robot equipment with which this invention was applied can make 
corresponding action appear again, when input and the action which appeared 
on that occasion are tied up and memorized and the same input is inputted again. 
[0374] The robot equipment concerning this invention connects the action result 



information which shows the result of having acted according to the input which 
the input detection means detected, and the input concerned, and memorizes 
them for a storage means. Moreover, with a behavior control means By 
specifying the action result information in a storage means, and acting based on 
the action result information concerned based on the newly inputted input When 
input and the action result information on a result that it acted according to the 
input are tied up and memorized and the same input is inputted again, the past 
action can be recollected based on the action result information which counters, 
and suitable action can be made to appear. 

[0375] Moreover, the behavior-control approach of the robot equipment 
concerning this invention has the storage process which connects the action 
result information which shows the result acted according to the input which the 
input detection means detected, and the input concerned, and memorizes for a 
record means, and the behavior-control process which specify the action result 
information in the above-mentioned storage means, and act based on the action 
result information concerned based on the newly inputted input. 
[0376] When input and the action result information on a result that it acted 
according to that input are tied up and memorized and the same input is inputted 
again, the robot equipment with which this invention was applied can recollect 
the past action based on the action result information which counters, and can 



make suitable action appear 

[0377] The robot equipment concerning this invention detects the characteristic 
quantity of the input which the input detection means detected with a 
characteristic quantity detection means, and classifies input according to an 
information classification means based on characteristic quantity. Moreover, with 
a behavior control means By changing the classification of the input which 
caused the action concerned with a reclassification means based on the action 
result information which shows the result of having acted based on the 
classification of input, and having been controlled by the behavior control means 
and having acted It can act according to the classification of input and the 
classification can be changed based on the result of having acted. 
[0378] Moreover, the behavior control approach of the robot equipment 
concerning this invention The characteristic quantity detection process of 
detecting the characteristic quantity of the input which the input detection means 
detected, The information classification procedure which classifies input based 
on the characteristic quantity detected at the characteristic quantity detection 
process, Based on the action result information which shows the result of having 
been controlled by the behavior control process which acts based on the 
classification of the input in an information classification procedure, and the 
behavior control process, and having acted, it has the reclassification process 



which changes the classification of the input which caused the action concerned. 
[0379] The robot equipment with which this invention was applied can act 
according to the classification of input, and can change that classification based 
on that result of having acted. 

[0380] Moreover, the robot equipment concerning this invention can carry out 
predetermined action, when a study object memorizes and the same object is 
again inputted by memorizing the information on the study object which a study 
object specification means specified a study object specified for a storage 
means, and acting with a behavior-control means based on the information on 
the study object memorized for the detected new object and the storage means. 
[0381] Moreover, the behavior-control approach of the robot equipment 
concerning this invention has the behavior-control process which acts based on 
the study object specification process of specifying a study object, the storage 
process which memorizes the information on the study object specified at the 
study object specification process for a storage means, and the information on 
the study object memorized for the detected new object and the storage means. 
[0382] The robot equipment with which this invention was applied can carry out 
predetermined action, when a study object is memorized and the same object is 
inputted again. 

[0383] Moreover, the joint section for the robot equipment concerning this 



invention to operate right-hand-side material and right-hand-side nnaterial, By 
having a study means to make a detection means to detect the condition of the 
joint section that external force is acting through right-hand-side material, and 
the condition and external force of the Joint section which the detection means 
detected correspond, and to learn them The condition and external force of the 
joint section which detected the condition of the joint section that external force 
was acting through right-hand-side material, with the detection means, and the 
detection means detected can be made to be able to respond, and it can learn 
with a study means. That is, robot equipment can be made to be able to respond 
to the condition of the joint section which changes according to the external force 
which acts on right-hand-side material, and can learn the external force 
concerned. 

[0384] The external force detection equipment concerning this invention 
moreover, by having a detection means to detect the condition of the joint 
section for operating right-hand-side material, and an external force detection 
means to detect the external force which acts on right-hand-side material based 
on the condition of the joint section which the detection means detected The 
external force which acts on right-hand-side material based on the condition of 
the joint section which detected the condition of the joint section for operating 
right-hand-side material with the detection means, and the detection means 



detected is detectable. That is, external force detection equipment can detect 
the external force which acts on right-hand-side material based on the condition 
of the joint section which operates the right-hand-side material concerned. 
[0385] Moreover, the external force detection approach concerning this invention 
can detect the condition of the joint section for operating right-hand-side material, 
and can detect the external force which acts on right-hand-side material based 
on the condition of the joint section which operates the right-hand-side material 
concerned by detecting the external force which acts on right-hand-side material 
based on the condition of the detected joint section. 



DESCRIPTION OF DRAWINGS 
[Brief Description of the Drawings] 

[Drawing 1] It is drawing showing the characteristic quantity space for detecting 
the characteristic quantity of an input signal. 

[Drawing 2] It is the block diagram showing the learning system equipped with 
the image, the recognition class about a sound, etc. 

[Drawing 3] It is drawing used for the explanation about generation of a new 
recognition class. 



[Drawing 4] It is drawing used in order to explain precedence reference 
(reference 4, Iwahashi et al.). 

[Drawing 5] It is drawing used in order to explain the relation between an innage 
feature space and a sound feature space. 

[Drawing 6] It is drawing used in order to explain the relation between an image 
feature space, a sound feature space, and the 3rd feature space. 
[Drawing 7] It is the perspective view showing the appearance configuration of 
the robot equipment which is the gestalt of operation of this invention. 
[Drawing 8] It is the block diagram showing the circuitry of above-mentioned 
robot equipment. 

[Drawing 9] It is the block diagram showing the software configuration of 
above-mentioned robot equipment. 

[Drawing 10] It is the block diagram showing the configuration of the middleware 
layer in the software configuration of above-mentioned robot equipment. 
[Drawing 11] It is the block diagram showing the configuration of the application 
layer in the software configuration of above-mentioned robot equipment. 
[Drawing 12] It is the block diagram showing the configuration of the behavioral 
model library of an above-mentioned application layer. 

[Drawing 13] It is drawing used in order to explain the finite stochastic automaton 
used as the information for the action decision of robot equipment. 



[Drawing 14] It is drawing showing the state transition table prepared for each 
node of a finite stochastic automaton. 

[Drawing 15] It is the block diagram showing the configuration of the part 
concerning this invention in above-mentioned robot equipment. 
[Drawing 16] It is drawing used in order to explain instruction of the actuation to 
robot equipment. 

[Drawing 17] It is the block diagram showing the discernment section which 
teaches actuation of robot equipment. 

[Drawing 18] It is the block diagram showing the discrimination circuit which 
learns actuation. 

[Drawing 19] It is drawing showing the pulse width used for study of operation, 
and it stands and is the property Fig. of the pulse width in a posture. 
[Drawing 20] It is drawing showing the pulse width used for study of operation, 
and is the property Fig. showing the pulse width when standing and pushing the 
back forward from a posture. 

[Drawing 21] It is drawing showing the pulse width used for study of operation, 
and is the property Fig. showing the pulse width when standing and pushing the 
back in the direction of back from a posture. 

[Drawing 22] It is drawing showing the pulse width used for study of operation, 
and is the property Fig. showing the pulse width when standing and pushing the 



head upward in a posture. 

[Drawing 23] It is drawing showing the pulse width used for study of operation, 
and is the property Fig. showing the pulse width when standing and pushing 
down the head in a posture. 

[Drawing 24] It is drawing showing the pulse width used for study of operation, 
and is the property Fig. showing the pulse width when pushing the head in the 
direction of the upper right in a stability posture. 

[Drawing 25] It is drawing showing the pulse width used for study of operation, 
and is the property Fig. showing the pulse width when pushing the head in the 
direction of the upper left in a stability posture. 

[Drawing 26] It is the block diagram showing ** and the unpleasant judging 
section of robot equipment. 

[Drawing 27] It is drawing used in order to explain a neural network. 
[Drawing 28] It is the gestalt of operation of this invention and is the block 
diagram showing the configuration which it has in order that robot equipment 
may learn external force. 

[Drawing 29] It is drawing showing the neural network by three-layer back 
propagation. 

[Drawing 30] It is drawing showing the configuration of the neurone of each class 
in the neural network by three-layer back propagation. 



[Drawing 31] It is the property Fig. showing a sigmoid function. 

[Drawing 32] It is the property Fig. showing the relation between the count of 

study, and a 2nd [ an average of ] power error. 

[Drawing 33] It is the block diagram showing a concrete configuration for the 
speech recognition section of robot equipment. 

[Drawing 34] It is the block diagram showing the associative remembrance 
storage section and the action generation section of robot equipment. 
[Drawing 35] It is the block diagram showing the associative remembrance 
storage section used in order to explain concrete processing. 
[Drawing 36] It is the block diagram showing the concrete configuration of the 
sensor processing section of robot equipment. 

[Drawing 37] It is drawing used in order to explain the joint study which specifies 
a study object with a finger. 

[Drawing 38] It is the block diagram showing the outline configuration of the 
example of an associative storage system. 

[Drawing 39] It is drawing showing the example of the competitive learning 
neural network of the two-layer hierarchical type used for an associative storage 
system. 

[Drawing 40] It is drawing showing the example of the change accompanying the 
count of presentation about association with the input neurone and the input 



neurone which has not ignited which ignited by a certain input configuration, and 
the neurone of a contention layer. 

[Drawing 41] In order to test action decision actuation of robot equipment, it is 
drawing showing the contents tree of the action decision system of the used 
layered structure. 

[Drawing 42] It is drawing showing Hunger (food intake avarice) of the instinct 
(instinct) in the 1st operation test, and time amount change of Sleepy (sleep 
avarice). 

[Drawing 43] It is drawing showing time amount change of the vigilance 
(Activation) as feeling (emotion) in the 1st operation test, the degree 
(Pleasantness) of **. and reliability (Certainly). 

[Drawing 44] It is drawing showing the sleep (Sleep) as motivation (Motivation) in 
the 1st operation test, and time amount change to eat (Eat). 
[Drawing 45] It is drawing showing time amount change of the instinct (instinct) in 
the 2nd operation test. 

[Drawing 46] It is drawing showing time amount change of the feeling (emotion) 
in the 2nd operation test. 

[Drawing 47] It is drawing showing time amount change of the release 
mechanism (Release Mechanism) in the 2nd operation test. 
[Description of Notations] 



1 Robot Equipment, 101 Right-Hand-Side Material, 152 Joint Section. 153 
Detection Means, 160 Study Means Speech Recognition Section, 102 Sensor 
Processing Section, 103 Instinct Emotion Section, 104 Associative 
Remembrance Storage Section, 105 Action Generation Section, 111 
Discernment Section, 122 Characteristic Quantity Extract Section, 123 The 
HMM Section, 131 Picture Signal Input Section, 132 Segmentation Processing 
Section, 133 Study Object Detecting Element, 151 



